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John Flannery, Dejan 
Nakarada-Kordic, Robert Pearl, 
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advice on how to deal with SSIS 

in clusters, move database files 
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19 Calculating Concurrent 


Sessions, Part 3 

—Itzik Ben-Gan 

Here’s a new set-based solution, created by readers, 
that’s about an order of magnitude faster than Itzik’s 
previous set-based solution. 


Optimizing Time-Based 
Calculations in SSAS 

—Tyler Chessman 

Although several approaches to time-based calculations 
for SSAS already exist, they have shortcomings. Here’s 
a novel approach that overcomes the shortcomings and 
provides end users with calculations that are flexible, 
easy to use, and efficient. 


Do You Have Hidden Cache 
Problems? 


—Andrew J. Kelly 

Most people know that proper plan reuse is essential 
to good performance, but there is another aspect that 
everyone should explore to ensure peak performance. 


Intelligent Stats Updater 
—Brian Smyk 

Use the IntelligentStatsUpdater stored procedure 
to efficiently update your statistics without greatly 
impacting your server. 


Using SSAS and SSIS to Build 
an IIS Web Log Cube 


—David Pruden 
Find out how to use these SQL Server tools to build a 
web log cube for tracking statistics and usage levels. 


Editor’s Tip 


Join us April 12—14 at the Bellagio Hotel and 

Casino in Las Vegas for the Visual Studio launch 

event, sessions, and expo. The SQL Server confer- 

ence and expo is collocated with the Visual Studio event. You can 

sign up and cross over between sessions for free. This is a great 

chance to brush up on SQL Server skills, learn about the SQL Server 

2008 R2 release, and see the latest developer tools from Microsoft. 
—Sheila Molnar, executive editor 


Fujitsu servers keep her data mm MD CO da 
as fresh as her produce. 


® A STORAGE 
st 


You 


of bananas—or a major year-end report. ie, 
That’s why Kellee’s business relies on T : | 
reliable Fujitsu PRIMEQUEST® servers | 
with Intel® Itanium® processors. | y | \ 


In the produce business, freshness is everything. 
A little downtime can spoil a big shipment f 9, 


® See how Fujitsu makes produce more 
productive at: 


© 2010 Fujitsu America, Inc. All rights reserved. Fujitsu and the Fujitsu logo are registered trademarks of Fujitsu Limited. PRIMEQUEST is a trademark of Fujitsu Limited 
in the United States and other countries. Intel, the Intel logo, Itanium and Itanium inside are trademarks of Intel Corporation in the United States and other countries. All 
other trademarks and product names are the property of their respective owners. 


ontents [WWW.SQLMAG.COM | 


MARCH 2010 Vol. 12° No.3 


COLUMNS 


7 Tool Time: 
Efficiently Clone Databases 
—Kevin Kline 
Follow the SQL Server CSS team’s step-by-step instructions for 
using SSMS scripts to clone databases. 
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37 Comparative Review: 
SQL Server Comparison and Synchronization 
Tools 
—Michael K. Campbell 
Red Gate Software’s SQL Compare 8.1 and SQL Data Compare 8.1, 
The Australian Software Company's SQL Delta 5.0, and ApexSQL 
Comparison Studio 2008 provide differencing and synchronization 
of SQL Server objects, code, and data. 


Industry News: 

Bytes from the Blog 

What are the biggest SQL Server trends for 2010? According to the 
CTO and founder of Sentrigo, they're cloud computing, virtualization, 
and a proliferation of hacking tools. 
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Check out the latest products from Idera, MVP Systems, Secerno, 
and Mike Morris. 
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Win a Spectacular Alaska Cruise! 


Don’t miss PASS Summit—the world’s best SQL Server and 
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www.sqlpass.org/na2010 and also have a chance to win a luxurious 
7-day Alaska cruise for two! 
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The Evolution of SQL 


Server BI 


ecently, Sheila Molnar and I talked with 

Tom Casey, general manager of Micro- 
soft’s SQL Server business intelligence (BI) 
unit, about the upcoming SQL Server 2008 R2 
BI enhancements. Tom explained that a goal 
of SQL Server 2008 R2 was to make it easier to 
turn data into useable information for end users, 
thus increasing the exposure of BI information 
throughout the enterprise. Tom mentioned that 
current estimates show that BI is used by 10 to 
15 percent of the people in an organization. By 
taking advantage of the enhancements in SQL 
Server 2008 R2 and its tight integration with 
both SharePoint and the upcoming Office 2010 
release, Tom said Microsoft hopes to push BI 
information further into the business, where it 
can be used by 30 to 40 percent of the people in 
an organization. 


A Short History of Microsoft BI 
Certainly this is a great goal, even if old SQL 
Server hands might question whether it can be 
achieved anytime soon. The goal might not seem 
so farfetched, though, when you remember how 
rapidly SQL Server has evolved over the past 10 
years and how instrumental it’s always been at 
bringing BI into to the mainstream. Back in 1998, 
with the release of SQL Server 7.0, Microsoft took 
the lead in the BI space. It was the first enterprise 
database vendor to offer a relational database server 
plus BI capabilities in the form of its new OLAP 
Services. Prior to this release, BI and OLAP were 
high-cost niche technologies used by a small subset 
of leading-edge businesses for specialized decision- 
support applications. 

SQL Server 7.0 changed that situation en- 
tirely. By including BI capabilities in the box 
with SQL Server, Microsoft revolutionized the 
relational database and the BI market, mak- 
ing BI much more affordable and accessible. 10 
years later, BI is a mainstream technology, and, 
although not every business makes use of BI, 
many do, and most know about the benefits 
that BI can bring. Customers today expect 


SQL Server Magazine + www.sqimag.com 


enterprise relational database vendors to have 
a BI offering. 


Introducing SSAS, SSIS, and SSRS 
Microsoft continued to improve its BI offer- 
ing in each subsequent release of SQL Server. 
In SQL Server 2000, it transformed OLAP 
Services into SQL Server Analysis Services 
(SSAS). In SQL Server 2005, Integration Ser- 
vices (SSIS) and Reporting Services (SSRS) 
were added. The addition of SSRS was another 
game-changing technology. SSRS broadened 
the definition of BI from MDX and OLAP 
cubes out to surfacing end-user decision-making 
information. 


The PowerPivot Generation 

The upcoming release of SQL Server 2008 R2, 
with its new Excel PowerPivot functionality, 
looks to extend BI even further by giving end us- 
ers more powerful BI capabilities within the Office 
tools they already know. Tom pointed out that 
Microsoft understands that end users don’t have 
the bandwidth to learn new specialized tools. BI 
information needs to be surfaced not through spe- 
cialized BI portals but through the tools that end 
users are familiar with. To ensure that Microsoft 
delivers a consistent and compelling BI offering 
across their product lines, Tom is leading a virtual 
BI team that includes members from each of the 
Microsoft business products such as Office and 
SharePoint. 


A BI Innovator 
Microsoft has been chided for lack of innova- 
tion, but that’s never been the case with SQL 
Server and BI. Microsoft has been the leader in 
evolving BI and expanding its value and 
adoption throughout the enterprise. Bring- 
ing the value of BI to between 30 to 40 percent 
of the enterprise might not be so farfetched 
after all. What do you think? Drop me a line at 
motey@sqlmag.com. SQL 
InstantDoc ID 103436 


Michael Otey 


(motey @ sqlmag.com) is technical director 
for Windows IT Pro and SQL Server 
Magazine and author of Microsoft SQL Server 
2008 New Features (Osborne/McGraw-Hill). 
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Efficiently Clone Databases 


Use the SQL Server CSS team's process to 
create a statistics-only database 


Ho you ever wanted to troubleshoot or 
performance tune a problem query, but the 
500GB database and 250GB transaction log made 
it impossible, simply because of the query’s sheer 
size? Wouldn't it be great if you could generate a 
facsimile of the database, keep it small, and still get 
realistic results from your query tuning? 

Thanks to SQL Server experts like Lubor Kollar, 
Keith Elmore, and Bob Ward, it’s now possible, 
and in some cases even easy, to create a clone of 
a database (aka a statistics-only database). The 
SQL Server Customer Service and Support (CSS) 
team has long used cloned databases to reproduce 
a database and to see what estimated query execu- 
tion plans look like without needing all of the data 
within the database, and the team is now making 
its process for cloning databases public for every- 
one to use. (Note that I previously reported on this 
type of utility, provided by consultant Joe Chang, 
in my Jn a Nutshell blog post “The Concept of 
a ‘shell’ database” at www.sqlmag.com/article/ 
articleid/49752/49752.html.) 

In effect, a cloned database includes all of the 
schema objects of the database (e.g., tables, views, 
stored procedures), as well as the statistics and 
histograms (the so-called “statistics blob”). This 
metadata is quite small by volume but can tell you 
what estimated query plans look like outside of a 
large production environment and how those esti- 
mated query plans might change when SQL Server 
is upgraded. Cloned databases are especially useful 
when the data is confidential, classified, or subject 
to privacy laws. 


New Scripting Features in SSMS 
The SQL Server CSS team hasn’t released a 
database cloning tool or script per se. Instead, SQL 
Server Management Studio (SSMS) in SQL Server 
2005 SP2 and later includes enhanced scripting 
features capable of providing enough information 
about the statistical distribution of data inside of 
tables and indexes to properly clone a database. 
The SQL Server CSS team has published 
its process for cloning a database in the article 
“How to generate a script of the necessary data- 
base metadata to create a statistics-only database 
in SQL Server 2005 and in SQL Server 2008” at 
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support.microsoft.com/default.aspx?scid=kb;EN- 
US;914288. It provides step-by-step instructions for 
scripting your entire database, as well as individual 
database objects. Also, this article notes that data- 
bases with thousands of schema objects can take a 
very long time to process, and that, because of the 
natural behavior of SSMS, some exceptionally large 
database scripts can be cumbersome to work with. 
Therefore, I recommend kicking off a database 
cloning session late in the day, before you head 
home for the evening. 

In a nutshell, SSMS uses these scripts to recre- 
ate not only the objects in the database (e.g., tables, 
views) but also all the information in those objects 
that’s used by SQL Server's query optimizer. In a hy- 
pothetical example, a 300GB database might be only 
500MB when cloned, and yet the cloned database 
will still return the same query execution plans. 


Start Cloning Databases Right 
Away 
Because you can clone databases easily 
by following the SQL Server CSS team’s 
simple, step-by-step instructions, you're 
ready to begin cloning databases right 
away. You can clone SQL Server 2008 
and later databases (Developer Edi- 
tion, Web Edition, Workgroup Edition, 
Standard Edition, and Enterprise Edition) and 
SQL Server 2005 SP2 and later databases (Develop- 
er Edition, Standard Edition, and Enterprise Edi- 
tion) and SQL Server 2008 and later databases (De- 
veloper Edition, Web Edition, Workgroup Edition, 
Standard Edition, and Enterprise Edition). EM 
InstantDoc ID 103410 


SUMMARY 


Kevin Kline 


(kevin.kline@ quest.com) is the director of 

technology for SQL Server Solutions at Quest 
Software and a founding board member of 

the international PASS. He is the author of 

SQL in a Nutshell, 3rd edition (O'Reilly). 


QD ititor Note 


We want to hear your feedback! Visit 


forums.windowsitpro.com/web/forum/ 


categories.aspx?catid= | 69&entercat=y. 


Benefits: You can use the database cloning technique to create a small, 
working copy of a database in which the data is too large or too sensitive for a 


development environment. 


System Requirements: SQL Server Management Studio; SQL Server 2008 


and later; SQL Server 2005 SP2 and later 


How to Get It: You can download the article “How to generate a soft 7 


Server 2005 ml in SQL Sne 2008” Tam Breme microsoft. RED 


.aspx?scid=kb;EN-US;914288. 
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I/O I/O It’s Why My Server’s Slow 


Three tips for getting and analyzing 
I/O information 


Server’s performance and present the information 
in a readable and useful format. Here are three 
useful tips I’ve come across for getting and analyzing 
I/O information: 
1. Use sys.dm_io_virtual_file_stats. 
2. Use SQL Server Performance Monitor to help 
identify I/O bottlenecks. 
3. Understand the infamous error message. 


KR always looking for ways to measure SQL 


Tip I 

A common way to measure SQL Server performance 
is to examine I/O statistics by using dynamic man- 
agement functions (DMFs) and dynamic manage- 
ment views (DMVs), which were introduced in SQL 
Server 2005. These dynamic management objects let 
you obtain many different types of statistics about a 
system’s state. With this information, you can monitor 
your system, tune its performance, and troubleshoot 
any problems that arise. 


SQL Server Magazine + www.sqimag.com 


A particularly useful I/O-related DMF is sys.dm_ 
io_virtual_file_stats, which returns I/O statistics 
for database files. This DMF’s num_of_bytes_read 
and num_of_bytes_written columns let you easily 
calculate total I/O. In addition to calculating total 
I/O, you can use common table expressions (CTEs) 
to determine the percentage of I/O usage, which tells 
you where most of the I/O is occurring. 

In the web-exclusive article “Querying DMFs 
to Analyze Performance Stats” (www.sqlmag.com/ 
Article/Article[D/93327/sql_server_93327.html), Itzik 
Ben-Gan provides a helpful tutorial on how to use sys 
.dm_io_virtual_file_stats. He provides several scripts, 
including the one that Listing 1 shows. This script 
uses a CTE to return the I/O usage for each database 
across all drives, regardless of the disk layout of the 
particular database. 

Determining I/O usage is useful in many scenarios. 
For example, if you have the opportunity to move files 
on one physical array to other physical arrays, you can 


At SQL Server 
Magazine, 
we've heard 
you loud and 
clear—you 
want articles written by 
experts that give you field- 
tested, practical solutions. 
Our very popular Reader 
to Reader issue gives you 
a chance to read solutions 
directly from other reader- 
experts. Of course, we run 
Reader to Reader content 
regularly in SQL Server 
Magazine, but this month 
we're shining a spotlight on 
four reader-experts who share 
tips, strategies, and solutions 
to hard problems they've 
faced. We love receiving your 
practical advice from the 
field, and | encourage you 
to send us your favorite 
solutions to the workplace 
challenges you’ve surmounted. 
We look forward to featuring 
your article! 

—Sheila Molnar, 

executive editor, 

SQL Server Magazine 


Robert Pearl 


founder and president, Pearl Knowledge 
Solutions, New York, rsp05 @ pearlknows.com, 
www. pearlknows.com 
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On Demand 
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HOW 
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What you'll learn: 
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would be considered candidates for consolidation 
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e how administering a consolidated SQL Server environment 
changes the DBA-related tasks you currently perform 


INSTRUCTORS: 
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Allan Hirt, a SQL MVP, consults for and trains clients 
all over the world. He has written or co-authored 
numerous SQL Server publications; his latest book is 
Pro SQL Server 2008 Failover Clustering (Apress). 


Ben DeBow is a MDCBA and MCSE focused on SQL 
Server consolidation and performance tuning. He 
has presented at SQL PASS, user groups, delivered 
training, and contributed to publications either as a 
co-author or reviewer. 


Learn more about the speaker, sessions, and 
how to reserve your seat at: 
windowsitpro.com/go/elearning/SQLServerConsolidation 


WindowsIT Pro 


determine which files have the highest I/O so that you © PhysicalDisk(_Total)\Avg Disk Queue Length. 


can put them on different arrays. This counter, which measures subsystem I/O, 
However, I/O usage doesn’t help much in determining is one of the main counters in Performance 

whether a performance problem exists. For instance, sup- Monitor. Avg Disk Queue Length is an estimate 

pose you determine the I/O usage of the files on a server. of the requests on the physical or logical disk 


You notice that one file has an I/O usage of 90 percent. 


Sounds like a problem, right? Not necessarily. If a fle LISTING I: Itzik Ben-Gan’s Code that Calculates 


is using 90 percent of the I/O but there's no waiting for the Percentage of I/O for Each Database 
reads or writes, you should be OK. The more users wait, 
the more performance is potentially affected. So, in this ee pee 


case, you also need to look at statistics that tell you how q EET 
long users have to wait for reads and writes to occur. To DB NAME(database id) AS database_name, 
P Å 4 å CAST(SUM(num of bytes read + num of bytes written) / 1848576. 
do so, you can use the io stall read. ms and io_stall_ AS DECIMALCI2, 2)) AS jo in mb 
write ms columns in sys.dm io virtual file stats. These FROM sys.dm io virtual. file stats(NULL, NULL) AS DM IO Stats 
. Š : GROUP BY database_id 
columns can tell you the total time that users waited for 
reads and writes to occur for a given file. SELECT ae 
in i ROW NUMBER() OVERCORDER BY io in mb DESC) AS row_num, 

In the script IO Percent by DriveLetter.sql database name, 

ae ; r io_in_mb, 
(Listing 2), I took advantage of the io stall read ms CAST(IO in mb / SUMCIO in mb) OVERO * 109 
and io stall write ms columns. You can use this script AS DECIMAL(5, 2)) AS pct 
toidet è hichdiski duce th t NO and FROM Agg_I0_Stats 
o determine which disk is producing the mos an ORDER BY row_num; 


which database that disk is related to. This information 
can be helpful in determining which database file should 
be moved to another disk. Figure 1 shows sample LISTING 2: 1O_Percent_by_DriveLetter.sql 
results. (You can download both scripts by going to 


i; ; WITH g As 
www.sqlmag.com, entering 103396 in the InstantDoc (SELECT db_name(mf.database_id) as database name, mf.physical_name, 


ID text box, and clicking the 103396.zip hotlink.) left(mf.physical. name, 1) AS drive letter, 
fe ; vfs.num_of_writes, 
Another way to look at I/O waiting is to use the io_stall ie mL es uren AS SES aE, 
column in sys.dm io virtual file stats. This column can vfs.io_stall_write_ms, 
: : 5 mf.type_desc, vfs.num_of_reads, vfs.num_of_bytes_read, 
tell you the total time that users waited for I/O on a given vfs.io_stall_read_ms, 
Å “ i i vfs.io_stall, vfs.size on disk bytes 
file. In his blog “SQL Server 2005 Emergency Diagnostic FROM cyeouseter cities mE 
and Performance Queries Part 1,” Glenn Berry uses the JOIN sys.dm io virtual file stats(NULL, NULL) vfs 


ON mf.database id=vfs.database id and mf.file id=vfs.file id 


io_stall column to analyze a database's I/O usage by the > Galen by of mina nes uren ESE) 


percentage of I/O stalls. You can find this code, which is ) 
SELECT database_name,drive_letter, BYTESWRITTEN, 


part of a script, by going to glennberrysqlperformance Percentage = RTRIM(CONVERT (DECIMAL (5,2), 
.spaces.live.com/blog/cens!45041418ECCAA960!893 —- BYTESWRITTEN*100.0/(SELECT SUM(BYTESWRITTEN) FROM g))) 
i --where drive letter='R'))) 
.entry and looking for the comment + 1%" 
FROM g --where drive_letter='R' 
ORDER BY BYTESWRITTEN desc 


-- IO ISSUES **#*8eeeeweee dees 
-- Analyze DB IO, ranked by IO Stall % 
< 
in the script. CE Resuts | Ba Messages 
As I mentioned previously, Microsoft introduced database_name dive letter. BYTESWRITT... io stall read ms io stall write ms Percentage 


[reneneetcseentene Tieeeeenteneem 


DMFs and DMVs in SQL Server 2005. If you're 1 [masters jC 245760 402 30 20.88% 
using SQL Server 2000, you can check out the article 2 ai z peer k ; nen 
“Examining SQL Server’s I/O Statistics” (www.novick % ie - FEE oi on ‘a nae 
software.com/Articles/sql-server-io-statistics.htm) for = made: c 147456 5258 9 1253% 
alternative methods to get and analyze I/O statistics. 6 model c 131072 214 39 11.14% 
Even if you’re running SQL Server 2005 or later, you 7 SQLCenttic Cc 85504 24 20 7.26% 
might want to read it. It’s a good primer on I/O statis- oo = cai i : at = 
tics. Plus, the scripts provided will work on SQL Server 2. aoe z reg =o ri ; = 
2005. (They'll likely work on SQL Server 2008 as well, 

but I haven’t tested them on that version.) 

Tip 2 @ Query executed successfully PEARLNYC(30SP3} 
You can use SQL Server Performance Monitor to help 

identify I/O bottlenecks. There are two I/O-related Figure I 

counters you can check: Sample results from IO Percent by DriveLetter.sql 
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that are either in service or waiting for service. 
As a general rule for hard disks, an Avg Disk 
Queue Length greater than 2 (per hard disk) for 
extended periods of time is considered undesir- 
able. If you have a RAID system with eight 
disks, you don’t want an Avg Disk Queue Length 
greater than 16 (16/8=2). Faster hard disks with 
quicker access times (and therefore quicker I/O) 
will allow greater flexibility with these numbers. 

e PhysicalDisk(_Total)\Avg Disk sec/Transfer. 
This counter reflects how much time a disk 
takes to fulfill requests. A high value might 
indicate that the disk controller is continually 
retrying the disk because of failures. These 
misses increase average disk transfer time. For 
most disks, high average disk transfer times cor- 
respond to values greater than 0.3 seconds, or if 
the value is more than 15 to 30 milliseconds, an 
I/O problem exists. 


If you'd like more information about Performance 
Monitor’s two I/O-related counters, read “Tips for 
Using Performance Monitor I/O Counters.” You can 
find this article at www.sql-server-performance.com/ 
tips/monitor_io_counters_p1.aspx. 


Tip 3 

Have you ever encountered the following I/O-related 
error message in the SQL Error Log and wondered 
what it was all about? 


SQL Server has encountered n occurrence(s) of IO 
requests taking longer than 15 seconds to complete on 
file <filename> in database <dbname>. 


This error message was added to SQL Server 2005 SP2 
to help identify issues affecting SQL Server's perfor- 
mance. It could indicate a poor disk subsystem, a mis- 
configuration, or a problem with the host bus adapter 
(HBA) driver or hardware connecting the server and 
SAN. It could also indicate fragmentation, excessive 


I/O requests not being handled properly by the disk, 
or data files not optimally placed on the disk. 

“I/O Requests Taking Longer Than 15 Seconds 
To Complete” (www.sql-server-pro.com/1-o-requests- 
taking-longer-than-15-seconds-to-complete.html) is 
an excellent article that delves into the origins and 
causes of this infamous error message. It’s definitely 
worth reading. 

The reason it’s so important to understand this 
error message, especially for DBAs, is that it’s often 
misunderstood by those who are not DBAs. When 
this error message occurs, system and SAN adminis- 
trators are often quick to blame the database server, 
when in actuality, SQL Server is simply being helpful 
in identifying a potential disk or hardware problem. 
And managers are more apt to viscerally accept a 
system or SAN administrator’s analysis over that of 
a DBA. So, the more you understand about this error 
message, the better you’ll be able to lead the system 
and SAN folks to the real underlying problem. 

This happened recently to a client of mine. It took 
some serious caucusing and long meeting hours to 
prove that it was in fact a disk problem. I identified 
the cause right away, but the skeptics needed more 
convincing and more disk and SAN diagnostic tests. 
Because the skeptics were fiddling while Rome was 
burning, several clusters crashed at regular intervals. 
As it turns out, the subsystem couldn’t keep up with 
the I/O requests generated from the SQL Server 
system because an HBA driver was improperly con- 
figured on the SAN. The SAN firmware had been 
upgraded but not the HBA drivers, which caused poor 
I/O throughput. The SAN firmware and the HBA 
drivers should have been upgraded simultaneously. 


Sing a Happier Tune 
I hope these three tips will prove helpful the next time 
your server is slow and you suspect it’s I/O related. 
The sooner you find and fix the I/O problem, the 
sooner you'll be singing a happier tune. 

InstantDoc ID 103396 


Move Database Files Without 
Taking the Database Offline 
The ALTER DATABASE and DBCC 
SHRINKFILE commands make it possible 


QL Server documentation describes two 
ANER for moving database files. The first 
method involves detaching a database, moving 
the files, then re-attaching the database. The second 


method involves taking a database offline, running 
the ALTER DATABASE command to change file 


locations, moving the files, and bringing the database 
back online. 

Both methods suffer from a major limitation: The 
database has to be offline. Another limitation is that 
for these methods to work, the DBA needs full access 
to the folders where the database files are kept. In large 
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organizations, this often isn’t the case, so the DBA 
doesn’t have sufficient permissions to move the files. 
Finally, the detach and re-attach method carries with 
it additional issues, such as having to change the data- 
base owner and having to reset the database options 
to their defaults (e.g., ENABLE_BROKER). 

To avoid all of these problems, I use a different 
method for moving database files. I create a new file 
using the ALTER DATABASE command, then move 
the data using the DBCC SHRINKFILE command 
with the EMPTYFILE option. Finally, I use another 
ALTER DATABASE command to remove the empty 
file. This migration operation is performed while the 
database is online. 

To demonstrate this method, I created two scripts, 
which you can try in your own environment. To 
download these scripts, go to www.sqlmag.com, enter 
103412 in the InstantDoc ID text box, and click the 
103412.zip hotlink. These scripts work on SQL Server 
2008 and SQL Server 2005. 

Here’s how the scripts work: The first script, 
which Listing 3 shows, creates a database with two 
file groups: PRIMARY (which contains a data file 
named test_primary_dat) and SECONDARY (which 
contains a data file named test_secondary_dat). In 
the SECONDARY file group, a table is created and 
populated with some sample data. 

The second script, which Listing 4 shows, adds 
another data file named test secondary dat NEW 
to the SECONDARY file group. Note that test_ 
secondary_dat_NEW is created in the same folder 
in which test_secondary_dat was created to keep this 
example simple by removing the need for a second disk. 
In a real-life scenario, you would create the additional 
data file on a disk where there is more free space. 

Next, the second script uses the DBCC SHRINK- 
FILE command with the EMPTYFILE option to 
migrate the data from the old file (test_secondary_ 
dat) to the new one (test secondary dat NEW) 
as an online operation. The old, empty file is then 
removed. 

As callout A in Listing 4 shows, the DBCC 
SHOWFILESTATS command is used to capture the 
size of the data files before and after the migration to 
see whether it was successful. This command’s output 
includes one record for each physical data file. Each 
record contains several columns, one of which is 
UsedExtents. The value listed under the UsedExtents 
column represents the amount of space used by the 
data in the file. Note that the UsedExtents value 
includes system metadata, so even an empty file won't 
show a 0 for this value. (For more information about 
DBCC SHOWFILESTATS, see “Avoiding the Red 
Zone,” December 2002, InstantDoc ID 26874.) 

My approach to moving database files does have a 
few limitations. First, it’s much slower than the other 
two methods. However, from the database availability 
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LISTING 3: Script that Creates a Database with a Table 


on a Secondary File Group 


USE master; 
GO 


-- Create a database that contains two file groups. 

CREATE DATABASE Test 
ON PRIMARY 
(NAME = test primary dat, FILENAME = 'c:\test_primary_dat 
FILEGROUP SECONDARY 


-mdf'), 


(NAME = test_secondary_dat, FILENAME = 'c:\test_secondary_dat.ndf') 


LOG ON 
(NAME = test_log, FILENAME = 'c:\test_log.ldf"); 
GO 


USE TEST; 
GO 


-- Create a table in the secondary file group. 

CREATE TABLE dbo.TestData (TestData_ID int identity(1999,2) 
NOT NULL PRIMARY KEY CLUSTERED, TestData_Field1 int) 
ON [SECONDARY]; 

GO 


-- Populate the table with some test data. 
DECLARE @counter int; 
SET @counter = 1; 
WHILE (@counter < 1999) 
BEGIN 
INSERT INTO dbo.TestData(TestData_Field1) 
VALUES (@counter) ; 
SET @counter = @counter + 1; 
END 
GO 


LISTING 4: Script that Moves the Data and Removes 


the Old File 


USE Test; 
GO 


-- Create a new file in the secondary file group. 
ALTER DATABASE Test 
ADD FILE 
(NAME = test secondary dat NEW, FILENAME = 
"c:\test_secondary_dat_NEW.ndf') 
TO FILEGROUP [SECONDARY]; 
GO 


(A) -- Show file size before emptying the file. 


DBCC SHOWFILESTATS; 
Go 


-- Empty the old file. 
DBCC SHRINKFILE ('test secondary dat', EMPTYFILE); 
Go 


-- Show file size after emptying the file. 
DBCC SHOWFILESTATS; 
Go 


-- Remove the empty file. 
ALTER DATABASE TEST REMOVE FILE test secondary dat; 
GO 


point of view, it’s actually faster because there’s a lot less 
downtime. Second, this method can’t be used to move 
system objects. This limitation can be avoided if you 
follow Microsoft’s recommended practice of keeping 
all your user objects in user file groups and leaving only 
system objects in the primary file group, as was done in 
this example. Third, the DBCC SHRINKFILE opera- 
tion can cause index fragmentation, so you should 
perform index maintenance after the data migration is 
complete. 

InstantDoc ID 103412 
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A Strategy for Dealing with SSIS 


in Clusters 


How to make configuring SSIS as a cluster 


resource a viable option 


sing Microsoft Server Clustering to 
U: multiple instances of SQL Server 

is common. For example, suppose you 
have an online instance, an extraction, transforma- 
tion, and loading (ETL) instance, and a reporting 
instance. You can serve these SQL Server instances 
as clustered virtual machines (CVMs) on four 
physical machines in an active/active/active/passive 
configuration. (See Figure 2.) The passive machine 
observes the status of the other three machines, 
ready to assume their functions if necessary. (Note 
that CVMs use clustering technology that has been 
around since SQL Server 7.0. They aren’t related to 
virtualization platforms, such as VMware ESXi or 

Microsoft Hyper-V.) 

Each SQL Server instance takes care of different 
needs, so each instance should run SQL Server Inte- 
gration Services (SSIS). However, complications arise 
when you use SSIS in a cluster because it is machine 
based rather than instance based like its predecessor 
DTS. In other words, in a cluster, SSIS runs on a 
physical machine, when most everything else runs on 
a CVM, as Figure 2 shows. As a result, using SSIS 
in a cluster presents several challenges to a solution 
architect: 

e In a production environment, you have lim- 
ited control over which physical machine an 
instance is running on. An instance can move 
from one physical machine to another very 
quickly in response to an event (e.g., hardware 
failure). 

e In clusters, it’s common for SSIS packages to be 
scheduled using SQL Server Agent. SQL Server 
Agent is (and always has been) an instance-based 
tool. So, in a failover, SQL Server Agent will 
move, but SSIS will not. 

e Development environments often have multiple 
SQL Server instances running on a single phys- 
ical machine but only one instance of SSIS. 


Because SSIS isn’t a cluster-aware service and 
doesn’t support failover, Microsoft doesn’t rec- 
ommend configuring SSIS as a cluster resource 
(although they provide instructions on doing so in the 
“Configuring Integration Services in a Cluster” web 
page at msdn.microsoft.com/en-us/library/ms345193 
.aspx). However, I’ve come up with a two-part strategy 
that addresses the challenges, making it a viable 
option. 
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The Strategy, Part I 
The first part of my strategy is to store production 
packages in the file system rather than in msdb. 
Although this is a major deviation from past SQL 
Server 2000 practice, it’s an important one. Here’s why. 
SSIS determines the location of msdb by looking 
in C:\Program Files\Microsoft SQL Server\100\DTS\ 
Binn\MsDtsSrvr.ini.xml. When SSIS is installed 
(regardless of whether the installation is local or 
clustered), Microsoft places the tag 


<ServerName>.</ServerName> 


in this file. This tag indicates that msdb can be found 
in the default instance of this physical machine. 
(Remember, SSIS is machine based.) However, there 
is no default instance on the physical machine. The 
instance runs on the CVM. 

You could change the tag on the physical machine 
that prodcvm01\online typically runs on to 


<ServerName>prodcvm1\on1ine</ServerName> 


You could even make the same type of change on 
the physical machines that your ETL and reporting 
instances typically run on. Everything will be fine as 
long as the CVM/physical machine relationship remains 
in its typical configuration. But what if there are serious 
hardware problems and the CVM with the online 
instance ends up running on the physical machine that 
typically hosts the reporting instance? Further, what 
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Name: prodcvm01\online 
IP: 192.168.1.6 


Clustered Virtual 


Name: prodcvm02\etl 
IP: 192.168.1.7 


dl! 


Name: proddb02 


C=) 


Name: proddb01 
IP: 192.168.1.2 


Physical Machine 
Level: SSIS, client 
tools, etc. 


SAN Storage 


Name: proddb03 
IP: 192.168.1.3 IP: 192.168.1.4 


Name: prodcvm03\reporting 
IP: 192.168.1.8 


aa) 


Name: proddb04 
IP: 192.168.1.5 


Figure 2 
Sample CVM configuration 
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value do you put into the MsDtsSrvr.ini.xml file on the 
passive physical machine? 

To avoid these issues, here’s what you can do: 

1. For each environment (e.g., production, 
development, quality assurance—QA), select one 
msdb. 

2. Create a package named Do Not Store 
Packages in msdb and store it in each selected msdb. 
This will serve as an eye catcher in case someone 
browses the msdb for packages. It has no other 
purpose. 

3. Point the MsDtsSrvr.ini.xml files on all four 
of the physical machines to the location of the 
one selected msdb. So, for example, if the msdb 
is in the online instance on the CVM named 
prodcvm01 in the production environment, the tag 
would look like 


<ServerName>prodcvm91\on1 ine</ServerName> 


on all the physical machines in the cluster group. 


The Strategy, Part 2 

Tm a big believer in using a formalized, consistent 
directory structure in which I store all my database files 
(e.g., data files, transaction logs, scripts, dumps). I copy 
this structure to every disk (or LUN) on a database 
server. The root of the structure is simply SqlData, 
which is followed by the name of the instance being 
supported (e.g., D:\SqlData\Online\). 

In that structure, I introduce an SSIS directory, 
which includes a subdirectory for every logical 
SSIS application supported on that instance. For 
example, D:\SqiData\ETL\SSIS\PartnerETL would 
be the directory for an SSIS application known as 
PartnerETL located on the ETL instance. In the 
application directories, I store SSIS packages as 
.dtsx files. 

In the root of the SSIS directory, I maintain and 
centrally manage a number of configuration files 
that are commonly used by the SSIS applications. I 
maintain one configuration file for every database in 
our architecture. Applications reference these con- 
figuration files by simply “reaching back” to them. 
For example, the common connection to the Online 
database can be used by referencing 


..\Online.dtsconfig 


within an SSIS package. 

I use SQL Server Agent jobs to schedule the execu- 
tion of SSIS packages. SQL Server Agent provides 
a job-step type of SQL Server Integration Services 
Package. There are two critical tabs when using this 
type of job step. In the General tab, you need to iden- 
tify the package to be run. In the Configurations tab, 
you need to identify the configurations needed by the 


package. You can use the GUI to create the job in a 
development environment. It then can be scripted. If 
everything is done properly, you can use the script as 
is in your nonclustered environment. To run the script 
in a clustered production environment, you'll only 
need to change the drive letters. Because the package 
is stored on a LUN that’s part of the cluster group 
and because the package is scheduled by SQL Server 
Agent (which is also part of the cluster group), the 
package will run regardless of what physical machine 
your CVM is located on. 


The Strategy’s Benefits 

Besides effectively dealing with the challenges associ- 

ated with implementing SSIS in a cluster, I’ve found 

that this strategy also has other advantages: 

e The centralized management of configuration 
files lets you use different connection strings in 
the various environments (e.g., development, 
production, QA). Further, SSIS packages can 
be moved between environments without altera- 
tion—and this is accomplished without the use 
of variables. 

e The process of “reaching back” promotes stan- 
dardization in package development. 

e The architecture is flexible. If one SSIS applica- 
tion needs additional configurations, you can 
simply place that configuration file in the appli- 
cation directory instead of in the root of the 
SSIS directory. (Note that you would then have 
to modify that configuration file if the applica- 
tion moves between environments.) 

e When using clusters in a production environ- 
ment, all the resources needed to run an SSIS 
application—including SQL Server Agent (which 
schedules the job) and the SSIS packages (which 
are located on a clustered file system)—will fail 
over as a unit. 

e Ina development environment where you 
run multiple SQL Server instances with mul- 
tiple SQL Server Agents on one machine, the 
agents can share a single SSIS instance. For 
example, D:\SqIData would contain three 
directories (Online, ETL, and Reporting), each 
of which would have its own SSIS directory. 
You’d configure the various agents to run the 
load it would be required to run in produc- 
tion. That is, the agent for the ETL instance 
wouldn’t run jobs for the online instance in 
QA, even though both agents exist on the 
same physical machine. 

e The .dtsx and .dtsconfig files are simple XML 
files. Deploying and maintaining these as files 
(as opposed to data in msdb) necessitates the 
enforcement of source-code management best 
practices. 

InstantDoc ID 103413 
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Pivoting Without Aggregation 
You can't remove the aggregate function, but 
you can take away its effect 


he PIVOT operator is a useful tool. It lets 

i you aggregate and rotate data so that you 

can create meaningful tables that are easy to 

read. However, there are times when you might not 

want to aggregate data while pivoting a table. For 

example, you might want to simply pivot the values 

in Table 1 so that each team has its members in one 

row, as Table 2 shows. But as the following basic 
syntax shows 


PIVOT 
(Aggregate function (column1) 
FOR column2 
IN ( [val1], [val2], [val3] )) AS P 


where 

e column! is the column you want to aggregate 

e column? is the column you want to pivot 

e [vall], [val2], and [val3] are the headings for 
the pivoted columns 

e P is the alias for the PIVOT expression’s results 


the PIVOT expression requires an aggregate 
function. 

I’ve developed a solution that lets you pivot 
data without aggregating it. Listing 5 illustrates this 
solution using the data in Table 1. The SELECT state- 
ment in callout B is key to this workaround. In this 
code, I query the tables’ Team and Member columns 
as well as the ROW_NUMBER function. I use the 
OVER clause with this function so that I can parti- 
tion and order the function’s result set by teams. This 
groups the members into their respective teams (CRM 
and ERP) and, within each team, gives members 

a number that 


TABLE |: Original Table specifies their 


position in that 


Member Team A 
group (ie., an 
Jack ERP ordinal number). 
John ERP Table 3 shows 
Mary ERP the result set 
Robert CRM produced by 
- this SELECT 
Diana CRM statement. 


TABLE 2: Pivoted Table 


Team  TeamMemberl TeamMember2 TeamMember3 
CRM Robert NULL 


ERP Jack John Mary 


Diana 
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Because each ordinal number is associated with 
only one member in each team, it’s now possible 
to use the MAX aggregate function in the PIVOT 
operation. (The maximum value of a data set with 
only one member will always be that member.) So, in 
the PIVOT expression in callout C, I use 


PIVOT (MAX(Member) 


to aggregate the Member column. I want to pivot the 
RowNum column, which I do with the code 


FOR RowNum 
In the last segment of the PIVOT expression 
IN ([1], [2], [3])) AS pvt 


I use aliases for the pivoted 
column headings. The actual 


Arie Stern 


DBA, Israel Police, Jerusalem, 


Arie.stern @ hotmail.com 


column headings are provided Callout B 

in the SELECT statement in {Team Member RowNum 
callout A. Note that when a CRM Rebert 1 
value that will end up as column - 

name doesn't follow the rules | CRM Diana 2 
for regular identifiers, you must | ERP Jack 1 
enclose it in brackets ([]). Finally, "ERP John 2 

I assign the PIVOT expression's ERP Mary 3 


results to pvt. 
As Listing 5 
demonstrates, 
although you 
can't take away 
the aggregate 
function in a 
PIVOT expres- 
sion, you can 
take away the 
aggregate func- 
tion's effect. If 
you'd like to 
try the code in 
Listing 5, you 
can download 
it by going to 
www.sqlmag 
.com, entering 


LISTING 5: Code that Pivots a Table 
Without Aggregating Data 


CREATE table #t ( 
Team varchar (28), Member varchar (20) 


) 

INSERT INTO #t values ('ERP', ‘Jack') 
INSERT INTO #t values ('ERP', 'John') 
INSERT INTO #t values ('ERP', 'Mary') 
INSERT INTO #t values ('CRM', 'Robert') 
INSERT INTO #t values ('CRM', 'Diana') 


SELECT * FROM #t 


SELECT Team, [1] AS TeamMember1, 
[2] AS TeamMember2, [3] AS TeamMember3 


FROM 
(B)GELECT Team, Member, 


ROW_NUMBER() OVER (PARTITION BY Team ORDER BY Team) 


AS RowNum 
FROM #t) a 


(Cjervor (MAX(Member) FOR RowNum IN ([1], [2], [31)) AS pvt 


103409 in the InstantDoc ID text box, and clicking 
the 103409.zip hotlink. It works on SQL Server 2008 
and SQL Server 2005. SOL} 
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TABLE 3: Result Set Produced 
by the SELECT Statement in 
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Calculating 


Goneurrant 
Sessions, Part 3 


A new set-based solution far exceeds 


previous solutions 


(November 2009, InstantDoc ID 102734) and 

“Calculating Concurrent Sessions, Part 2” 
(December 2009, InstantDoc ID 102926), I covered 
a task to calculate the maximum number of concur- 
rent sessions for each application. I started the series 
by presenting a set-based solution (call it Original 
Set-Based Solution) that didn’t perform well because 
it had quadratic algorithmic complexity. I also pre- 
sented a cursor-based solution (call it Cursor-Based 
Solution) and explained that the cursor alternative 
performed better because it had linear complexity. 
In the second part of the series I presented a new 
set-based solution (call it New Set-Based Solution 1) 
with linear complexity. This solution performed better 
than the cursor-based solution, but it involved using 
a temporary table, a couple of scans of the data, 
plus a seek operation in an index for each row from 
the table. 

I thought that New Set-Based Solution 1 was 
the best available, but I was pleasantly surprised 
to learn about a fantastic set-based solution (call 
it New Set-Based Solution 2) that performs even 
better. Several readers sent me this solution. New 
Set-Based Solution 2 doesn’t involve the use of any 
temporary tables, requires only two scans of the 
data, and has linear complexity. In a benchmark test 
that I ran, it proved to be an order of magnitude 
faster compared with New Set-Based Solution 1. 
I'd like to thank Ben Flanaghan, Arnold Fribble, 
and R. Barry Young for coming up with the new 
solution. 


i n “Calculating Concurrent Sessions, Part 1” 


Creating and Populating 

the Table 

When I originally presented the task, I provided 
code to create and populate a table called Sessions. 
Listing 1 contains the code to create and populate 
the Sessions table with sample data. Listing 2 con- 
tains code to create a helper table function called 
GetNums, which returns a table result with a 
sequence of integers of a requested size. Listing 3 
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contains the code to populate the Sessions table 
with a large set of rows to test the performance of 
the solutions. 

As a reminder, you're supposed to calculate the 
maximum number of concurrent sessions (active 
simultaneously) for each application. If one applica- 
tion ends at the same time that another starts, you're 
not supposed to consider the two as concurrent. 
Table 1 shows the desired results for the sample data 
provided in Listing 1. 


New Set-Based Solution 2 

Like the cursor-based solution that I covered pre- 
viously, New Set-Based Solution 2 relies on uni- 
fying start and end events into one chronological 
sequence of events, associating a +1 event type to 
start events, and a -1 event type to end events. How- 
ever, instead of using a cursor to process the records 
one at a time and keep aggregating the event type to 
calculate the count of concurrent sessions 
at each point, New Set-Based Solution 2 
uses row numbers to calculate the count 
of concurrent sessions. The technique is 
ingenious and surprisingly simple. The 
first part of the solution involves calculating start 
ordinals (how many sessions started so far), as 
well as start-or-end ordinals (how many sessions 
either started or ended so far). Start ordinals are 
calculated by assigning row numbers, partitioned 
by app, ordered by starttime, only to start events, 
and assigning a place holder (e.g., a NULL) to end 
events, like so: 


SELECT app, starttime AS ts, +1 AS type, 
ROW_NUMBER() OVERC(PARTITION BY app 
ORDER BY starttime) AS start_ordinal 
FROM dbo.Sessions 


UNION ALL 


SELECT app, endtime, -1, NULL 


FROM dbo.Sessions; 


Itzik Ben-Gan 


(Itzik@ SolidQ.com) is a mentor with Solid 
Quality Mentors. He teaches, lectures, and 
consults internationally. He's a SQL Server MVP 
and is the author of several books about 
TSQL induding Microsoft SQL Server 2008: 
FSQL Fundamentals (Microsoft Press). 
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LISTING I: Code to Create and Populate 
the Sessions Table 


SET NOCOUNT ON; 
USE tempdb; 


IF OBJECT ID('dbo.Sessions', 


CREATE TABLE dbo.Sessions 
( 


keycol 
app 
usr 
host 


starttime DATETIME 


endtime 


INT NOT NULL, 
VARCHAR(1@) NOT NULL, 
VARCHAR(1@) NOT NULL, 
VARCHAR(1@) NOT NULL, 


DATETIME 


NOT NULL, 
NOT NULL, 


CONSTRAINT PK Sessions PRIMARY KEY(keycol) , 
CHECK(endtime > starttime) 


5 
Go 


"U') IS NOT NULL DROP TABLE dbo.Sessions; 


CREATE INDEX idx nc app st et ON dbo.Sessions(app, starttime, endtime); 
CREATE INDEX idx nc app et st ON dbo.Sessions(app, endtime, starttime); 


INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(2, 'appl', 'userl', 'hostl', '2ØØ9Ø212 Ø8:3Ø', '2ØØ9Ø212 1Ø:3Ø'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(3, 'appl', 'user2', 'hostl', '2ØØ9Ø212 Ø8:3Ø', '2ØØ9Ø212 Ø8:45'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(5, 'appl', 'user3', 'host2', "2ØØ9Ø212 Ø9:ØØ', '2ØØ9Ø212 Ø9:3Ø'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(7, 'appl', 'user4', 'host2', '2ØØ9Ø212 Ø9:15', '2ØØ9Ø212 1Ø:3Ø'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(11, 'appl', 'user5', 'host3', "2ØØ9Ø212 Ø9:15', '2ØØ9Ø212 Ø9:3Ø'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(13, 'appl', ‘user6', ‘host3', '20098212 1Ø:3Ø', '2ØØ9Ø212 14:30'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(17, 'appl', ‘user7', 'host4', '2ØØ9Ø212 18:45', '2ØØ9Ø212 11:38'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(19, 'appl', ‘user8', 'host4', "'2ØØ9Ø212 11:ØØ', '2ØØ9Ø212 12:38'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(23, ‘app2', ‘user8', 'host1', '2ØØ9Ø212 Ø8:3Ø', '2ØØ9Ø212 98:45'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(29, 'app2', ‘user7', 'host1', '2ØØ9Ø212 09:00', '2ØØ9Ø212 99:30'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(31, ‘app2', ‘user6', ‘host2', '2ØØ9Ø212 11:45', '2ØØ9Ø212 12:00'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(37, ‘'app2', ‘user5', ‘host2', '2ØØ9Ø212 12:38', '2ØØ9Ø212 14:ØØ'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(41, 'app2', 'user4', 'host3', '2ØØ9Ø212 12:45', '2ØØ9Ø212 13:30'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(43, ‘app2', ‘user3', 'host3', '2ØØ9Ø212 13:ØØ', '2ØØ9Ø212 14:00'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(47, ‘app2', ‘user2', 'host4', '2ØØ9Ø212 14:ØØ', '2ØØ9Ø212 16:38'); 
INSERT INTO dbo.Sessions(keycol, app, usr, host, starttime, endtime) 
VALUES(53, ‘app2', ‘userl', 'host4', '2ØØ9Ø212 15:38', '2ØØ9Ø212 17:00'); 
GO 
Run Time Concurrent Sessions Benchmark 
(seconds) 
50 
45 


40 + 
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To calculate start-or-end ordinals, define a common 
table expression (CTE—call it Cl) based on this 
query, and then in the outer query, assign row num- 
bers to the unified events, partitioned by app, and 
ordered by ts and type, like so: 


WITH C1 AS 
( 
SELECT app, starttime AS ts, +1 AS type, 
ROW_NUMBER() OVER(PARTITION BY app 
ORDER BY starttime) AS start_ordinal 
FROM dbo.Sessions 


UNION ALL 


SELECT app, endtime, -1, NULL 
FROM dbo.Sessions 


) 
SELECT *, 
ROW_NUMBER() OVERCPARTITION BY app ORDER BY 
ts, type) AS start or end ordinal 
FROM C1; 


Table 2 shows the output of this code in abbreviated 
form. 

Now that you have start ordinals (start ordinal attri- 
bute) and start-or-end ordinals (start or end ordinal 
attribute), you can easily calculate how many sessions 
ended at each point: end_ordinal = start or end 
ordinal — start_ordinal. To calculate the count of active 
sessions at each point, simply subtract end_ordinal 
from start_ordinal: cnt = start_ordinal — end_ordinal = 
start_ordinal — (start_or_end_ordinal — start_ordinal) 
= 2 X start_ordinal — start_or_end_ordinal. So the only 
thing left is to group the data by app, and calculate the 
maximum count for each application, like so: 


WITH C1 AS 
( 
SELECT app, starttime AS ts, +1 AS type, 
ROW_NUMBER() OVER(PARTITION BY app 
ORDER BY starttime) AS start_ordinal 
FROM dbo.Sessions 


UNION ALL 


SELECT app, endtime, -1, NULL 
FROM dbo.Sessions 


Ji 
C2 AS 
¢ 

SELECT *, 

ROW_NUMBER() OVER(PARTITION BY app 
ORDER BY ts, type) AS start_or_end_ 
ordinal 

FROM C1 

) 
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LISTING 2: Code to Create the GetNums TABLE |: Desired Results 
a woo 
IF OBJECT ID('dbo.GetNums', 'IF') IS NOT NULL appl 4 


DROP FUNCTION dbo.GetNums; 


Go 
CREATE FUNCTION dbo.GetNums(@n AS BIGINT) RETURNS TABLE o el 


AS 
RETURN 
WITH 


LØ AS(SELECT 1 AS c UNION ALL SELECT 1), . i 
L1 AS(SELECT 1 AS c FROM LØ AS A CROSS JOIN LØ AS B), TABLE 2: Ordinals 


E 
G 
L2 AS(SELECT 1 AS c FROM L1 AS A CROSS JOIN L1 AS B), 
L3 AS(SELECT 1 AS c FROM L2 AS A CROSS JOIN L2 AS B), 
L4 AS(SELECT 1 AS c FROM L3 AS A CROSS JOIN L3 AS B), 
L5 AS(SELECT 1 AS c FROM L4 AS A CROSS JOIN L4 AS B), 
Nums AS(SELECT ROW NUMBER() OVER(ORDER BY (SELECT @)) AS n FROM L5) 


aa TOP(@n) n FROM Nums ORDER BY n; appl 9009-02-12 08:30:00.000 il 


appl 2009-02-12 08:45:00.000 -1 NULL 


LISTING 3: Code to Populate the Sessions Table re 


with a Large Number of Rows a [AMEND ION ] I 
Use anpes appl 2009-02-12 09:30:00.000 -1 NULL 
DECLARE @i AS INT; 2 
SER ance Siena -- Change this value according to your needs appl 2009-02-12 10:30:00.000 1 NULL 


(keycol, app, usr, host, starttime, endtime) 
SELECT 


ROW_NUMBER() OVER(ORDER BY (SELECT NULL)) AS keycol, solution’s algorithmic com- 
D.*, fie 
DATEADD( plexity is linear. 
second, Figure 1 shows the bench- 
1 + ABS(CHECKSUM(NEWID())) % (20*68), ; ; 
starttime) AS endtime mark results for this solution 
co compared with the other three 
SELECT solutions that I covered pre- 
"app' + CAST(1 + ABS(CHECKSUM(NEWID())) % 1@ AS VARCHAR(10)) AS app, : 
'user1' AS usr, viously. Note that the graph 
"host1' AS host, : 
BATEADD( for New Set-Based Solution 2 
second, seems to merge with the X axis; 
1 + ABS(CHECKSUM(NEWID())) % (30*24*60*60), i Søk 
"20090101') AS starttime this solution is about an order 
FROM dbo.GetNums(@numrows) AS Nums ; 
MERE ia ao Canines of magnitude faster than New 
) AS D; Set-Based Solution 1. 


GO 


An Aha! Moment 
My recent experience with the 
SELECT app, MAX(2 * start ordinal - start or end task of calculating the maximum number of concur- 


ordinal) AS mx rent sessions truly inspired me. After many years 
FROM C2 of thinking that a cursor-based solution was the 
WHERE type = 1 best way to address the task, I found a better set- 
GROUP BY app; based solution, and then an even better one. This 


discovery gives me hope that there are other kinds 

Not only is this solution beautiful in its simplicity, its of problems for which a good-performing set-based 
also extremely efficient. Web Figure 1 (www.sqlmag solution hasn’t yet been found, but exists. The expe- 
.com, InstantDoc ID 103407) shows this solutions rience also reinforced my opinion that it’s worth- 
execution plan. while to revisit such problems from time to time, as 
Similar to what I described about the cursor- well as to let others look at problems, in hopes of 
based solution in the previous articles in this series, gaining new insight. I’m continually amazed at the 
SQL Server relies on index ordering to unify start profoundness of calculations based on the OVER 
and end events with a Merge Join operator, as well clause. Perhaps the SQL Server development team 
as to calculate both the start ordinals and start-or- will finally see the light, and will enhance SQL 
end ordinals with the ROW NUMBER function. Server’s support for the OVER clause with standard 
Amazingly, this plan doesn’t involve a single sort features that are still missing. SQL] 
operator! As you probably realize, this means that the InstantDoc ID 103407 
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«VDI and desktop virtualization 
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- The dynamic data center 
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Get the whole picture on the Microsoft Hyper-V and 
VMware solutions, including product comparisons 


Optimizing 


Time-Based 
alculations in 


A novel approach 


QL Server Analysis Services (SSAS) pro- 

vides built-in MDX functions to facilitate 

time-based calculations. For example, these 
functions are often used for period-to-period and 
same-period-last-year comparisons. (If you’re unfa- 
miliar with these MDX functions and calculations, 
see the web-exclusive article “The Concepts Behind 
Time Calculations in SSAS” at www.sqlmag.com/ 
Article/ArticleID/103356/sql_server_103356.html.) 
Although approaches to leverage the MDX func- 
tions exist, they have shortcomings. I developed 
an approach that overcomes the shortcomings 
and strives to provide end users with calculations 
that are flexible, simple to use, and offer good 
performance. 

Tl begin by describing commonly used 
approaches to time-based calculations (which involve 
a time utility dimension) and the shortcomings of 
those approaches. I'll then walk you through the 
approach I developed. Although I use SQL Server 
2008 in the examples, my approach also works with 
SQL Server 2005. 


Commonly Used Approaches 

As I discuss in my web-exclusive article “The Con- 
cepts Behind Time Calculations in SSAS,” adding 
distinct time-based calculations for each measure 
(and applicable time-based dimension attribute/hier- 
archy) can result in bloated, unwieldy cubes. A time 
utility dimension can be used instead. 

In 2002, I came across the concept of a time 
analysis utility dimension (now typically referred 
to as time utility dimension) while reading the first 
edition of George Spofford’s MDX Solutions (John 
Wiley & Sons, 2001). In Spofford’s approach, you 
manually add a new single-member dimension 
(with a static value such as [Current]), then add 
a calculated member to the dimension for each 
type of desired analysis (e.g., period-to-period, 
same-period-last-year, year-to-date). The result is 
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a flexible cube that has a small set of calculated 
member definitions. 

For example, look at the pivot table in Figure 1. 
This pilot table is tracking two economic indicators: 
unemployment and consumer price index (CPI). A 
Time dimension hierarchy is displayed along the rows of 
the pivot table, and a Time utility dimension is displayed 
along the columns. The two columns underneath the 
Current member display the actual measure values for a 
given date, while the PriorPeriod and YearAgo columns 
represent calculated members. 

The clever part of this approach is that the Current, 
PriorPeriod, and YearAgo members are generic (i.e., 
not explicitly defined against any particular measure) 
and defined only once. Measure values can be switched 
in and out of this pivot table. When you do so, the Cur- 
rent, PriorPeriod, and YearAgo values will 
update accordingly. 

Let’s walk through an implementation of 
a time utility dimension built directly into 
SSAS: the Business Intelligence Wizard’s “time intel- 
ligence” option. (The Business Intelligence Wizard 
was first introduced in SSAS 2005.) 

If you'd like to follow along, you can download 
the files in Chessman_TimeAnalysis_CodeSamples 
.zip by going to www.sqlmag.com, entering 103355 


a g cC P ' s 
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Pivot table from a cube in which a time utility dimension was manually added 
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TIME-BASED CALCULATIONS 


Choose Enhancement 
Choose the enhancement that you want to add. 


Available enhancements: 


Define time intelligence 

Define account intelligence 
Define dimension intelligence 
Specify a unary operator 

Create a custom member formula 
Specify attribute ordering 

Define semiadditive behavior 
Define currency conversion 


Description: 


Use time intelligence to add additional time views automatically for a selected hierarchy. These views 
include period-to-date, rolling average, and period-to-period. 


Figure 2 


Selecting the Define time intelligence option 


in the InstantDoc ID text box, and clicking the 
103355.zip hotlink. The underlying data, which 
comes from the Organisation for Economic 
Co-operation and Development (www.oecd.org), 
compares economic trends across different 
countries. 

Start by restoring the SQL Server 2008 rela- 
tional database from the DebtAnalysis.bak 
backup file. Next, open the OLAP_GovtData 
.dwproj project in Business Intelligence Develop- 
ment Studio (BIDS). Edit the project’s target server 
property to match the location of your SSAS 
instance. Finally, after editing the DebtAnalysis.ds 


Dimension Operator Filter Expression 
DimCountry Equal 
<Select dimension> 
Drop Filter Fields Here 
H-Year DimDate Calculations v 
Current DimDate Year Over Year Growth ‘ter Over Quarter Growth 
Calendar Year v |Calendar Qtr Desc| Month |UnemploymentAvg UnemploymentAvg UnemploymentAvg 
1987 NA 
[m 1988 NA 
1989 NA 
E 1990 E 1990-Qtr1 1990-Jan | 5.37% 5.37% 5.37% 
1990-Feb| 5.29% 5.29% 5.29% 
1990-Mar| 5.24% 5.24% 5.24% 
Total 5.30% 5.30% 5.30% 
E 1990-Qtr2 5.34% 5.34% 0.04% 
1990-Qtr3 5.69% 5.69% 0.35% 
E 1990-Otr4 6.11% 6.11% 0.43% 
Total 5.61% 5.61% NA 
E 1991 B 1991-Qtr1 1991-Jan |6.36% 1.00% 0.44% 
1991-Feb/6.56% 1.27% 0.40% 
1991-Mar|6.80% 1.56% 0.54% 
Total 6.57% 1.27% 0.46% 
EH 1991-Qtr2 6.82% 1.49% 0.25% 
E 1991-Qtr3 6.85% 1.17% 0.03% 
m 1991-Qtr4 7.10% 0.98% 0.24% 
Total 6.84% 1.23% NA 
[E 1992 7.50% 0.67% NA 
E 1993 6.91% 0.59% NA 
Figure 3 


Pivot table from a cube in which a time utility dimension was added using BIDS 
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data source to reflect the location of the DebtAnal- 
ysis relational database, process the entire database 
using the Database menu’s Process option. 

With the OLAP_GovtData project open in 
BIDS, make a copy of the GovtDebtAnalysis 
cube. (Alternatively, you can see the output in the 
GovtDebtAnalysis_BIW.cube file in Chessman_ 
TimeAnalysis_CodeSamples.zip.) Open the copied 
GovtDebtAnalysis cube in the BIDS designer. On the 
Calculations tab, select the Add Business Intelligence 
option from the Cube menu to start the Business Intel- 
ligence Wizard. After navigating past the Welcome 
window, select Define time intelligence in the Choose 
Enhancement window, as Figure 2 shows. Next, choose 
the [H-Year] hierarchy and select the following check 
boxes in the Available time calculations section: 

e Year Over Year Growth 
e Quarter Over Quarter Growth 
e Month Over Month Growth 


Finally, in the Define Scope of Calculations 
window, select the applicable measures to be included 
in the calculations. In my example, I selected all the 
measures in the wizard. (Note that in the cube’s cal- 
culations script, I manually removed the measures 
for the Fact OECDGDP measure group from the 
quarterly and monthly growth calculations because 
these measures are defined at an annual grain—e., 
detail at the annual level.) Click Next to review the 
changes the wizard will implement, then click Finish 
to implement them. The major changes implemented 
by the Business Intelligence Wizard include the 
following: 

e A new named calculation (H-Year DimDate 
Calculations 1) is added to the dsv_DebtAnalysis 
data source view with a static value of [Current 
DimDate]. Likewise, an attribute (also named 
H-Year DimDate Calculations) is added to the 
DimDate dimension. 

e A calculated member is created for each time 
calculation you selected in the wizard. Each 
member is initially defined with a value of NA. 

e Each calculated member is associated to specific 
measures and cube cells (specifically, along the 
attributes in the DimDate dimension) through 
assignments. 


Figure 3 shows a pivot table from the resulting 
cube. The time utility dimension and unemployment 
rates are displayed in the columns. The H-Year hier- 
archy is displayed in the rows. 


The Shortcomings 

In versions earlier than SSAS 2005, time dimensions 
were relatively easy to work with. SSAS 2005 and 
its introduction of the Unified Dimensional Model 
(UDM) changed everything. Today, dimension 
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DimTimeCalcs.dim [Design] | DimDate.dim [Design! = x [Solution Explorer - Solution ‘SSIS LoadGoviData’ (2... ~ 2 X 


attributes, multiple dimension hierarchies, and role- 


; 3 i mer $ q i Æ Attribute Relationsh fransia! lela 
playing dimensions make it difficult to implement je aane E | ee ee = Ip Dimensions : 
É . . i pala- xlama- r” LZ DimCountry.dim E 
flexible and comprehensive time-based calculations. promt nem eee ee Eine fa 
: . Hd DimTimeCalcs.dim > 
Most of the time-based calculation examples I’ve (FYRES {Solution Explorer [=p Clas View] 
encountered ignore these issues. Examples in which = sails 
. "1° . . r TimeCalcs DimensionAttribute hd 
time utility dimensions are manually added are typically NE 
limited to a single dimension hierarchy. The built-in E Advanced 
. . g i AttributeHierarchyDisplayFolder 
Business Intelligence Wizard doesn’t effectively address AttributeHierarchyEnabled True 
i eae ae AttributeHierarchyOptimizedState FullyOptimized 
these challenges either because it's limited to building AttributeHierarchyVisible True 
å . ` 2 : DefaultMember [Current] 
calculations for either a single-attribute or single- DiscretizationBucketCount 0 i 
. . . . DiscretizationMethod None 
dimension hierarchy. Furthermore, the Business Intel- EstimatedCount 0 
. . . . IsAggregatabli False 
ligence Wizard has relatively weak error-handling a Key 
rere: OR è OrderByAttribute 
capabilities to account for missing data along a time ProcessingState Unprocessed 


dimension. 


A New Approach 

My approach to time-based calculations involves 
manually creating a time utility dimension. It’s based 
on concepts from David Shroyer’s white paper “A 
Different Approach to Implementing Time Calcu- 
lations in SSAS” (www.obs3.com/ssas_tips.shtml), 
ideas from Mosha Pasumansky’s blog “Time Calcu- 
lations in UDM: Parallel Period” (sqlblog.com/blogs/ 
mosha/archive/2006/10/25/time-calculations-in-udm- 
parallel-period.aspx), and the results of my own 
research. At a high level, I used Shroyer’s framework 
for creating a time utility dimension. I integrated 
performance optimizations from Pasumansky’s 
blog and used an explicit attribute-based method of 
scoping the calculations across the time dimension 
(and any role-playing dimensions based on the time 
dimension). 

To walk through this new approach with me, 
make a copy of the GovtDebtAnalysis cube in 
the OLAP_GovtData project. (Alternatively, the 
GovtDebtAnalysis_TUD.cube file in Chessman_ 
TimeAnalysis_CodeSamples.zip contains a com- 
pleted implementation.) Then follow these steps: 

1. Add a new dimension attribute to the existing 
time dimension. 

2. Create a new dimension. 

3. Add the new dimension to the cube. 

4. Add the time calculations to the cube. 

5. Test the cube. 


Step I. Add a New Dimension 
Attribute 

The first task in adding a new dimension attribute 
to the existing time dimension is to add a new 
named calculation to the DimDate table in the dsv_ 
DebtAnalysis data source view. Name it TimeCalcs 
and assign it the static expression value of N'Current'. 
Next, add TimeCalcs as an attribute to the DimDate 
dimension, setting the AttributeHierarchyVisible 
property to False. This attribute isn’t used in the 
DimDate dimension, but it’s needed for configuring 
a referenced dimension relationship in Step 3. 
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Figure 4 


Changing the IsAggregatable and DefaultMember properties 


Step 2. Create a New 
Dimension 

Now you need to create a new shared dimension. Right- 
click Dimensions in Solution Explorer, and select the 
New Dimension menu item to start the Dimension 
Wizard. As you work through the Dimension Wizard, 
choose the Use an existing table option, select DimDate 
as the main table, and select the named calculation 
(i.e., TimeCalcs) as both the Key column and Name 
column. Name your dimension DimTimeCalcs. 

The DimTimeCalcs dimension will be used for 
calculations, not aggregations. Therefore, we don’t 
want an All level in the dimension. With your Dim- 
TimeCalcs dimension open in the editor, select the 
TimeCalcs attribute. Change the IsAggregatable 
property to False and change the DefaultMember to 
[Current], as Figure 4 shows. Save the changes and 
close the dimension designer. 


Step 3. Add the New Dimension 
to the Cube 

The next step is to add the new DimTimeCalcs 
dimension to the cube. In Solution Explorer, 
double-click the cube to open it. Right-click 
anywhere on the Dimension Usage tab and select 
Add Cube Dimension. For each measure group, 
set the relationship type to Referenced, as seen in 
Figure 5. 

After you’re done configuring the measure 
groups’ relationship type, highlight the new 
dimension in the Dimensions Usage tab and 
set the HierarchyUniqueNameStyle property to 
ExcludeDimensionName. Because this dimension 
doesn’t contain user-defined hierarchies, you can 
simplify any MDX reference to include just the 
attribute name. 


Step 4. Add the Time 
Calculations to the Cube 

You're now ready to add the time calculations to 
the cube. Select the Calculations tab and switch to 
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A i TIME-BASED CALCULATIONS 


GovtDebtAnalysis TUD.cube [Design] | 
GB Cube Structure | !B] Dimension Usage |Q} Calculations 
BG) we] 21 al x 


(Although these lines wrap here, you’d enter each 
CREATE MEMBER statement on one line.) 


Æ e's |EG Actions |@ Partitions |J}? aggregations | fj) Perspectives | fj Translations 


Next, you need to limit, or scope, the calculations 


Measure Groups X 
pinansin El A irexosoae al ss ea to each desired dimension attribute in the DimDate 
S DimCount ni ouni . . rr . : 
— mn rn dimension, as Listing 1 shows. Notice that this 
tg DimDate Date Date å i 2 F 
code defines only a PriorPeriod calculation and not 
18 DimTimeCalcs |> omae ë B 18 DimDate 
- a YearAgo calculation for the Century dimension 
ČE Define Relationship E] 8 y 


Select relationship type: Referenced 


The dimension table is joined to an intermediate table, which in turn, is joined to the fact table. 


Reference dimension: DimTimeCalcs 


Intermediate dimension: [DimDate 
Relationship 


vi 


Reference dimension attribute: TimeCales 


Intermediate dimension attribute: {TimeCalcs 


[7] Materialize 


@ Path: DimTimeCalcs <- DimDate 


Figure 5 


Configuring the relationship type of each measure group 


LISTING I: Code that Scopes the 
PriorPeriod Calculation 


SCOPE( [DimDate]. [Century]. [Century] .Members) ; 
-- PriorPeriod calculation 
( [TimeCalcs].[PriorPeriod] = 
(C [DimDate] . [Century] .CurrentMember.PrevMember 
, [TimeCalcs]. [Current] ) 


5 
END SCOPE; 


LISTING 2: Code that Scopes the 
PriorPeriod and YearAgo Calculations 


SCOPE( [DimDate].[Calendar Qtr].[Calendar Qtr] .Members) ; 
-- PriorPeriod calculation 
C C [TimeCalcs].[PriorPeriod] , 
{ [Measures] .[CPI_Base2905], [Measures].[UnemploymentAvg] } ) 
= ( [DimDate]. [Calendar Qtr].CurrentMember .PrevMember 
» [TimeCalcs]. [Current] ) 
J; 
-- YearAgo calculation 
C C [TimeCalcs].[YearAgo] , 
{ [Measures]. [CPI_Base2995], [Measures].[UnemploymentAvg] } ) 
= ( [DimDate].[Calendar Qtr] .CurrentMember.Lag(4) 
» [TimeCalcs]. [Current] ) 


@) 


END SCOPE; 


the Script view. First, you need to add and define 
the new calculations. For example, the following 
code adds the PriorPeriod and YearAgo calcula- 
tions to the [TimeCalcs] dimension attribute of the 
DimTimeCalcs dimension, and defines their default 


value as Null: 


CREATE MEMBER CURRENTCUBE. 
[TimeCalcs].[PriorPeriod] AS Null; 

CREATE MEMBER CURRENTCUBE. 
[TimeCalcs].[YearAgo] AS Null; 
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attribute. Including a YearAgo calculation doesn’t 
make sense given that this dimension attribute’s 
context is century. However, for many of the other 
attributes, it does make sense, so you need to define 
both the PriorPeriod and YearAgo calculations, as 
shown in Listing 2. 

To scope the YearAgo calculation for the Cal- 
endar Qtr dimension attribute, you can simply use 
MDxX’s Lag function with an index of 4, as callout 
A in Listing 2 shows. I prefer using the Lag func- 
tion rather than MDX’s ParallelPeriod function 
because ParallelPeriod requires a hierarchy level as 
an input. 

In case you're unfamiliar with the Lag function, 
it returns the member that’s the specified number of 
positions before the specified member. In this case, the 
specified member is the current quarter ([DimDate] 
[Calendar Qtr].CurrentMember) and the index is 4, 
so the lag function returns the quarter that was four 
quarters ago (i.e., a year ago). Alternatively, you 
could use the Lag function with the Month dimen- 
sion attribute in code such as 


[DimDate] . [Month] .CurrentMember.Lag(12) 


to return a year-ago value. However, you shouldn’t 
use the Lag function with the Date dimension attri- 
bute to obtain a year-ago value. Code such as 


[DimDate] . [Date] .CurrentMember.Lag(365) 


typically doesn’t work due to leap years. In this 
instance, you'd need to use the ParallelPeriod function. 
None of the measure groups in my cube have a daily 
grain, so I didn’t use the ParallelPeriod function. 

You can find all the code needed for step 4 in the 
MDX script in the GovtDebtAnalysis.cube file in 
Chessman_TimeAnalysis_CodeSamples.zip. After 
you ve finished scoping the time calculations for each 
desired attribute, you need to process the cube. 

Note: There’s a shortcut you can take to scope 
all the attributes participating in a dimension hier- 
archy. I included an example in the comments of the 
MDX script in the GovtDebtAnalysis_TUD cube, 
and you can see the same approach in the MDX 
code generated by the Business Intelligence Wizard. 
I decided to define calculations one attribute at a 
time because, for large cubes, it can be difficult to 
keep track of which attributes do and do not par- 
ticipate in a hierarchy. 
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Also, for some types of time-based calculations 
(e.g., PeriodsToDate), you need to explicitly define 
and scope multiple calculations for an attribute 
participating in multiple hierarchies. For example, 
a PriorPeriod or YearAgo calculation should be the 
same regardless of hierarchy, but a year-to-date cal- 
culation will be different when querying a Calendar 
versus Fiscal hierarchy. 


Step 5. Test the Cube 

Before you let end users query the cube, you should 
test the cube by using the browser in BIDS to simulate 
an end user or by creating a connection to the cube 
from an application such as Microsoft Excel. If you 
use BIDS, you might encounter an “unknown error” 
on certain navigation paths because of a bug in the 
BIDS browser. 

These errors don’t show up in Excel. If you're 
using Excel, make sure you go into the PivotTable 
options and select Show calculated members from 
OLAP server on the Display tab. 

Figure 6 contains a sample pivot table that shows 
historical unemployment rates in the United States. 
The TimeCalcs dimension is displayed in the col- 
umns. The PriorPeriod and YearAgo calculations 
are properly scoped at yearly, quarterly, and monthly 
levels. If you have Excel 2007, you can open the 
pivot table spreadsheet (Excel_PivotTables.xlsx) and 
explore the various measures, date attributes, and date 
hierarchies. 

Note that the GovtDebtAnalysis cube you just 
created doesn’t contain role-playing dimensions. If 
you have time-based role-playing dimensions (e.g., 
OrderDate, ShipDate) in a cube, you can copy and 
paste all the scoped calculation definitions, then 
replace the dimension name with the role-playing 
dimension name. Because my approach uses a 
referenced time utility dimension rather than using 
the [TimeCalcs] attribute directly from the date 
dimension, the calculations will work across all the 
role-playing dimensions. 


Benefits of the New Approach 
So what can your end users gain from all this 
effort? Consider the original goal of providing 
end users with flexibility, simplicity, and good 
performance: 

e Flexibility. Regardless of the measures, date 
attributes, or date hierarchies being queried, 
the [Current], [PriorPeriod], and [YearAgo] 
calculations are automatically computed and 
appropriately displayed. Other approaches to 
time utility dimensions don’t do this. 

e Simplicity. Only two calculated members were 
added to provide time-based analysis across 
the entire cube, avoiding the problem of calcu- 
lated measure explosion inherit in traditional 
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TIME-BASED CALCULATIONS 


a es Tc |» | 
1 


"2 |H-Continent United States |»7| 
3 
_4 |UnemploymentAvg Column Labels |= 
_5 [Row Labels | >| Current PriorPeriod YearAgo 
6 | #1990 5.61% 
7 | 21991 6.84% 5.61% 5.61% 
_8 | 81992 7.50% 6.84% 6.84% 
9 | 21993 6.91% 7.50% 7.50% 
10| ®1993-Qtr1 7.15% 7.41% 7.38% 
11| &1993-0tr2 7.07% 7.15% 7.59% 
12| ®1993-Qtr3 6.80% 7.07% 7.63% 
13| ®1993-Qtr4 6.62% 6.80% 7.41% 
14 | 51994 6.09% 6.91% 6.91% 
ESI =1994-Qtr1 1 6.56% 6.62% 7.15% 
16 1994-Jan 6.61% 6.52% 7.26% 
EA 1994-Feb 6.57% 6.61% 7.15% 
18 1994-Mar 6.50% 6.57% 7.04% 
19| = 1994-002 6.17% 6.56% 7.07% 
20| #1994-Qtr3 6.00% 6.17% 6.80% 
21| ®1994-Qtr4 5.62% 6.00% 6.62% 
22 | ©1995 5.60% 6.09% 6.09% 
23 | ©1996 5.40% 5.60% 5.60% 
24 | ©1997 4.94% 5.40% 5.40% 
25 | ©1998 4.51% 4.94% 4.94% 
26 | 9.1999 4.22% 4.51% 4.51% 
27 | ©2000 3.99% 4.22% 4.22% 
28 | 32001 4.75% 3.99% 3.99% 
29 | ©2002 5.78% 4.75% 4.75% 
30 | 32003 5.99% 5.78% 5.78% 
31 | 22004 5.52% 5.99% 5.99% 
32 | ©2005 5.08% 5.52% 5.52% 
33 | 22006 4.62% 5.08% 5.08% 
34 | 82007 4.62% 4.62% 4.62% 
35 | ©2008 5.80% 4.62% 4.62% 
36 | #2009 8.87% 5.80% 5.80% 
37 | ©2010 8.87% 8.87% 
38 |Grand Total 5.58% 
Figure 6 


Pivot table from a cube in which a time utility 
dimension was added using the new approach 


approaches. (For an example of calculated mea- 
sure explosion, see “The Concepts Behind Time 
Calculations in SSAS.”) 

e Good performance. The MDX script contains no 
runtime-dynamic statements (e.g., CASE, HF). 
Instead, the script uses static scoping to avoid 
potential performance issues. It also efficiently 
eliminates erroneous calculations at the start and 
tail end of the date dimension. For example, in 
Figure 6, notice that years without unemploy- 
ment rates (1790-1989) don’t appear in the pivot 
table and the PriorPeriod and YearAgo results 
for the first year containing data (1990) correctly 
show a null value. 


Give It a Try 
I encourage you to try this new time-calculation 
approach in your existing cubes and any new cubes 
you need to create. Your end users will be more 
productive and independent. Although the imple- 
mentation involves a bit of up-front effort, it should 
reduce the amount of overall time spent on custom 
calculations. SQL 
InstantDoc ID 103355 
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or dynamic SQL queries, this cache can grow to 
hundreds of megabytes in size. 

As the cache grows in size, the time it takes to 
check the permissions of anything with a 65535 ID 
takes longer and longer to complete. The most notice- 
able symptom is that everything slows down and 
timeouts might occur. The overall CPU usage on the 
SQL Server system will generally appear to be on par 
with normal workloads, but less work overall will be 
getting done. You'll most likely see an increase in the 
SOS_SCHEDULER_YIELD wait type, too. You 
might have experienced these symptoms, but I bet you 
haven’t attributed them to the TokenAndPermUser- 
Store—you probably hadn’t heard of it before! 


Smoking Gun 

How do you know whether you're a victim of this 
problem? That determination is fairly simple. The fol- 
lowing query shows you the amount of memory that 
the TokenAndPermUserStore cache is consuming: 


SELECT SUM(single_pages_kb + multi_pages_kb) AS 
"CurrentSize0fTokenCache(kb)" 
FROM sys.dm os memory clerks 
WHERE [name] = 'TokenAndPermUserStore' 


As far as the size the cache can reach before problems 
start manifesting themselves, that can depend on 
several factors. But, generally, if it’s under 10MB, you 
should be fine. I’d start getting concerned between 
10MB and 50MB. If the amount of consumed 
memory is over 50MB, you're probably affected by 
this problem. And, obviously, the higher the level, the 
worse your problems will be. 


Resolution 
This problem is most prevalent on SQL Server 2005, 
particularly prior to SP3. SP2 introduced some changes 
to help with the situation, and SP3 added further fixes. 
But neither service pack completely eliminated the 
problem (although SP3 let you adjust the amount of 
memory that the TokenAndPermUserStore can use). 
I know many of you are using SQL Server 2005 
with service packs ranging from SP1 to SP3, and 
combined with heavy use of ad hoc SQL, you're prone 
to these problems. So, do yourself a favor and read 
through the aforementioned articles and check your 
system to see where you stand. You might be surprised 
to find that this problem has been affecting you all 
along, and you never knew it. SQL 
InstantDoc ID 103141 


Audit Database changes, 
Read the SQL Transaction Log 


ApexSQL Log 2008 


The Ultimate Log Reading, Auditing Tool 
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ik SQL Server 2008 and 64-bit support 


ie Integrates with Database backups for improved audit trails 


yf Analyze historical activity of each transaction 


yf Rollback or reconstruct operations 
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Do You Have 


Hidden Cache 


Problems? 


Discover how ad hoc queries can adversely 
affect your SQL Server 2005 system 


ne thing I hate to see while troubleshooting 
o) performance problems on clients’ systems is 
a failure to reuse query plans. Before SQL 
Server can execute a batch file or stored procedure, 
it must first determine the most proper and efficient 
way to execute each statement within that batch file 


or stored procedure. This process results in a query 
plan that's stored in the procedure cache. (Don’t 


unique query plan needs to get generated, even though 
the only difference might have been the value for the 
SARG in the WHERE clause. 

This situation can wreak havoc on the system in sev- 
eral ways; most often, it results in excessive CPU usage 
because every submitted query needs to go through the 
costly optimization process described above. Another 
result is that a large amount of memory might be uti- 


Andrew J. Kelly 


is a SQL Server MVP and the practice manager 
for performance and scalability at Solid Quality 


Mentors. He has 20 years experience with 


let the name fool you: All query plans reside in the 
procedure cache, regardless of the type of database 
object they represent.) 

Now, the purpose of storing the query plan is 
simple. Generating the query plan is often a relatively 


lized for the procedure cache, particularly on the 64-bit 
editions of SQL Server. The procedure cache can grow 
to 6GB in size, mostly filled with plans that will never 
relational databases and application develop- be reused. What a waste of good memory! 
ment. He is a regular speaker at conferences 
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and user groups. 


expensive operation. You wouldn’t want to go through 
SQL Server’s optimization process every time you 
execute the batch file or stored procedure because it 
would always add time to each execution. It makes 
more sense take a small hit upfront once, then reuse the 
query plan for each subsequent execution of the same 
batch file or stored procedure. This configuration saves 
an enormous amount of time and resources on busy 
systems—more so than most people realize. In fact, 
T’ve seen more than my fair share of systems crippled 
because they don't reuse query plans. 

Before I go much further, I highly recommend 
taking a look at Kalen Delaney’s “Controlling 
Parameterizatin” (InstantDoc ID 96349) and “Reusing 
Query Plans” (InstantDoc ID 46233), which offer 
detailed discussions of plan reuse and the procedure 
cache. Also, be sure to check out the Microsoft article 
“Plan Caching in SQL Server 2008” (msdn.microsoft 
.com/en-us/library/ee343986.aspx), the majority of 
which is relevant to SQL Server 2005. 


Troubled Roots 

Most of the problems associated with not reusing 
query plans stem from an overuse of ad hoc queries. 
In this case, I'll define an ad hoc query as one or more 
statements sent from the client to SQL Server without 
regard to proper parameterization (as outlined in the 
aforementioned articles). In a nutshell, this means 
that potentially for each statement called, a new and 


Evil Cousin 

Most of you have seen those problems and are at least 
familiar with the concepts behind them. The symptoms 
are easy to spot. But you probably aren’t as familiar with 
another deadly aspect of query plans—one that involves 
performance. It’s related to another cache in SQL Server 
memory, called the TokenAndPermUserStore. As its 
name implies, this normally tiny cache stores tokens and 
permissions related to the plans in the cache. Of special 
note in this cache is an entry called the cumulative 
permission check, which has an ID of 65535. 

The Microsoft article “Queries take a longer time 
to finish running when the size of the TokenAnd- 
PermUserStore cache grows in SQL Server 2005” 
(support.microsoft.com/kb/927396) goes into detail 
about this more insidious problem, but essentially the 
TokenAndPermUserStore cache maintains the security 
token types LoginToken, TokenPerm, UserToken, 
SecContextToken, and TokenAccessResult—and many 
TokenAccessResult entries that have the 65535 ID. 

Not unlike an actual query plan, the cached entry 
here is intended to speed up security checks each time a 
given query runs. And just as each ad hoc query creates 
a new query plan and places it into the procedure cache, 
it inserts a new entry for the TokenAndPermUserStore 
cache, as well. On a system with reuses query plans 
effectively, this cache would be as large as only a 
few megabytes, making each new lookup fast and 
efficient. But on a 64-bit system with lots of ad hoc 
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or dynamic SQL queries, this cache can grow to 
hundreds of megabytes in size. 

As the cache grows in size, the time it takes to 
check the permissions of anything with a 65535 ID 
takes longer and longer to complete. The most notice- 
able symptom is that everything slows down and 
timeouts might occur. The overall CPU usage on the 
SQL Server system will generally appear to be on par 
with normal workloads, but less work overall will be 
getting done. You'll most likely see an increase in the 
SOS_SCHEDULER_YIELD wait type, too. You 
might have experienced these symptoms, but I bet you 
haven’t attributed them to the TokenAndPermUser- 
Store—you probably hadn’t heard of it before! 


Smoking Gun 

How do you know whether you're a victim of this 
problem? That determination is fairly simple. The fol- 
lowing query shows you the amount of memory that 
the TokenAndPermUserStore cache is consuming: 


SELECT SUM(single_pages_kb + multi_pages_kb) AS 
"CurrentSize0fTokenCache (kb) " 
FROM sys.dm os memory clerks 
WHERE [name] = 'TokenAndPermUserStore' 


As far as the size the cache can reach before problems 
start manifesting themselves, that can depend on 
several factors. But, generally, if it’s under 10MB, you 
should be fine. I'd start getting concerned between 
10MB and 50MB. If the amount of consumed 
memory is over 50MB, you're probably affected by 
this problem. And, obviously, the higher the level, the 
worse your problems will be. 


Resolution 
This problem is most prevalent on SQL Server 2005, 
particularly prior to SP3. SP2 introduced some changes 
to help with the situation, and SP3 added further fixes. 
But neither service pack completely eliminated the 
problem (although SP3 let you adjust the amount of 
memory that the TokenAndPermUserStore can use). 
I know many of you are using SQL Server 2005 
with service packs ranging from SP1 to SP3, and 
combined with heavy use of ad hoc SQL, you're prone 
to these problems. So, do yourself a favor and read 
through the aforementioned articles and check your 
system to see where you stand. You might be surprised 
to find that this problem has been affecting you all 
along, and you never knew it. SQL 
InstantDoc ID 103141 
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procedure 


nsuring that statistics are up-to-date is a critical 

maintenance task because statistics are used by 

the query optimizer to choose an optimal query 
plan. Poor statistics can result in poor query plans, which 
can result in poor performance of both the individual 
query and the overall server. If a poor query plan is 
chosen in my environment, which has a federated farm 
containing both large and small clients on my multi- 
database servers, a spike in CPU usage can occur (often 
read: CPU pegged at 100 percent). 

Like many of you, I always ensure my indexes 
are properly maintained. I rebuild and reorganize 
indexes whenever I have the opportunity and have 
the auto update statistics asynchronously option 
enabled for any statistics that might not 
have been updated during an index rebuild. 
In theory, based on the rebuilds and 
frequency of data changes triggering auto- 
matic statistics updates, the statistics in my 
environment should be up-to-date. However, even 
with all of these measures in place, there’s still the pos- 
sibility that my statistics could be out-of-date because 
of how the auto update statistics option functions. 
Thus, I set out to find a better way of ensuring that 
statistics are fresh. 

The initial requirements for my process were pretty 
standard: I wanted to ensure statistics were updated 
efficiently and with the least amount of impact on 
my server as possible. I created the IntelligentStats- 
Updater stored procedure to accomplish this task. Let’s 


take a look at this stored procedure and its param- 
eters. (You can download IntelligentStatsUpdater.sql 
by going to www.sqlmag.com, InstantDoc ID 103405, 
and clicking the 103405.zip file.) 


The Graduated Update Scale 
Simply put, executing IntelligentStatsUpdater will 
locate out-of-date statistics based on input param- 
eters and update them using a Graduated Update 
Scale to determine an appropriate statistics sample 
percentage for the table size. Line 590 of Intelligent- 
StatsUpdater.sql, which Figure 1 shows, is the case 
statement that constitutes the Graduated Update 
Scale. I chose to use a case statement because it’s 
easy to read and modify. 

You must use caution when updating statistics 
using the FULLSCAN option on large tables because 
it’s performance-intensive and comes with the inherent 
potential for blocking while statistics are gathered. 
Large tables that have millions of rows might need only 
a small percentage to sample for proper statistics. That's 
why I based the update statistics sample percentage on 
the number of rows in a specific table. 

The scale I use is based on what I know works given 
the data and high transactional volume in my environ- 
ment. Although you can use the scale right out of the 
box, the frequency and the degree to which you update 
your statistics is dependent on your environment. I 
encourage you to explore and tweak the conditions to 
suit your needs. 


590! @SamplePercent = CASE IntelligentStats- 

591 WHEN (RowsCount < 50000) — 100 i Updater’s Input 

592: WHEN (RowsCount >= 50000 AND RowsCount < 100000) THEN 25 

593) WHEN (RowsCount >= 100000 AND RowsCount < 250000) THEN 16 Parameters 

594: WHEN (RowsCount >= 250000 AND RowsCount < 500000) THEN 8 : 

595) WHEN (RowsCount >= 500000 AND RowsCount < 1000000) THEN 6 The IntelligentStatsUpdater 

596, WHEN (RowsCount >= 1000000 AND RowsCount < 5000000) THEN 4 stored procedure includes sev- 

597 WHEN (RowsCount >= 5000000) THEN 2 

598l Eib eral features that are controlled 

by input parameters to target 

Figure | statistics and databases and 


Case statement used to select sample percentage based on row count limit the impact on the server. 
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INTELLIGENT STATS UPDATER 


The first input parameter is 
@DaysOlderOutDated. This is 
the number of days equal to or 


5 Results | EE Messages | 
DatabaseName 


TableSchema | StatsName | StatlID | RowsCount 


LastUpdated 
Mystatl 1 26360386 2009-08-31 08:18:31.977 P 


ProcessStatus 


after which you consider statistics E MyTable  MyDB dbo Mystat2 2 26360386 2009-08-31 08:14:34.280 P 
: (3 | MyTable  MyDB dbo Mystat3 — 3 26360386 2009-08-31 08:14:38.553 P 

to be out-of-date. For instance, [4 | MyTable  MyDB dbo Mystatd 4 26360386 2009-08-31 08:14:43.953 P 

if you assign @DaysOlder- 5 | MyTable MyDB dbo Mystat5 5 26360386 2009-08-31 08:18:27.953 P 

OutDated a value of 7, any sta- 

tistics with a date that’s seven days Figure 2 


or older than the current date will The UpdateStatsProcessList table 


be updated. If you want to target 

or exclude specific databases on every run, @DBInclude 
and @DBExclude, which are comma-delimited strings 
of databases to either include or exclude, can be very 
helpful. 

The next few parameters are important to the 
impact of the overall update process. The @MaxStats- 
ToUpdate value specifies the maximum number of 
statistics you want to update in the current execu- 
tion. For example, I have 4,246 statistics that can be 
updated on any given run. To minimize the proce- 
dure’s effect on my server and to have the procedure 
complete in a reasonable amount of time, I limit 
@MaxStatsToUpdate to 1,000. In addition, you can 
use the @WaitForMinutes and @WaitForSeconds 
parameters to provide a delay between update execu- 
tions, giving your server a little time to breathe. 

It’s important to note that you have to be careful 
when assigning @MaxStatsToUpdate a value. I run 
IntelligentStatsUpdater via a scheduled job that I 
included in CreateJob_IntelligentStatsUpdater.sql, 
which you'll find in the 103405.zip file. By default, I 
set the scheduled job to run every two days. If your 
environment has several thousand statistics like mine 
and you were to, for instance, run the job only once 
a week with @MaxStatsToUpdate set to 1,000 and 
@DaysOlderOutDated set to 7, you would only ever be 
updating the first 1,000 statistics every week. If you use 
@MaxStatsToUpdate, make sure you appropriately set 
the job schedule and the @DaysOlderOutDated value. 

If you want to run IntelligentStatsUpdater via a 
scheduled job, simply run the CreateJob_Intelligent- 
StatsUpdater.sq] script that’s in the 103405.zip file after 
running IntelligentStatsUpdater.sql to create the Intel- 
ligentStatsUpdater stored procedure. Be sure to change 
the references to the database named [Common] in 
both scripts to the name of the database in which you'll 
create the IntelligentStatsUpdater stored procedure. 


Messaging and Debugging 
Parameters 

I always prefer to see what a procedure is going to do 
before it actually does the work. If you set @debug 
to 1, you'll see a verbose output of data from both 
SELECT and PRINT statements. If you set @Print- 
Output to 1, you'll see just the printed UPDATE state- 
ments as they're being executed. You can’t have both 
@debug and @PrintOutput set to 1 at the same time. 
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The procedure uses a table named Update- 
StatsProcessList to keep track of anything it processes. 
(Note that I use a database called [Common] for all 
of my maintenance scripts, so you'll want to modify 
IntelligentStatsUpdater.sql and CreateJob_Intelligent- 
StatsUpdater.sql to replace all references to Common. 
dbo. UpdateStatsProcessList with the database in your 
environment.) This table gives you a list of each data- 
base, table, index, and statistic targeted for update, 
as Figure 2 shows. It also gives you the row count of 
each table and the last updated date of each statistic, 
and it lets you know whether a statistic was chosen for 
update via the ProcessStatus column. The ProcessStatus 
values are P for processed, R for ready, and I for ignore. 
Anything greater than the @DaysOlderOutDated cal- 
culated date, as well as tables with zero rows, will have 
a ProcessStatus value of I. 

The final two parameters are @BuildStats- 
TableDataOnly and @KeepStatsTableData. These 
parameters are used for debugging and can’t both be 
set to 1 at the same time. @BuildStatsTableDataOnly 
executes the procedure and creates the UpdateStats- 
ProcessList output table. It’s useful if you want to 
see the last update date on all statistics. You use 
@KeepStatsTableData in the event that you executed 
the procedure with a @MaxStatsToUpdate value less 
than the total number of statistics and simply want to 
process the next batch count of @MaxStatsToUpdate 
without having to recalculate the table. Keep in mind 
that all data collected, such as row counts and statistics 
dates, are from DMVs and system tables on which 
querying shouldn’t have a noticeable impact on your 
system. 


Update Statistics with Little 
Impact 
With IntelligentStatsUpdater, all statistics are 
kept up-to-date with as little impact on your SQL 
Server system as possible. I have been running 
IntelligentStatsUpdater for several months now 
in my transactionally active environment, which 
demands near perfect uptime, to ensure that it 
performs well in a very busy environment. Almost 
immediately I noticed an improvement in perfor- 
mance. I hope it benefits your environment as it 
has mine. Happy updating! SOU 
InstantDoc ID 103405 
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Using SSAS and SSIS 
to Build an 


IIS Web Log Cube 


Use these tools to track historical 


statistics and usage 


anually combing through the data in the 
M web log files created by a Microsoft HS 

server can be tedious. It can be a quick 
way to look at an application or end-user error, 
but it's not practical for trend analysis or usage 
statistics. IIS doesn’t have a good built-in tool for 
compiling the data and transforming it into useful 
information. There are third-party applications 
and services that you can use, but they may pro- 
vide only basic statistics or reports that can't be 
customized to filter out “bots” or used to identify 
potential threats. Our office didn’t have the budget 
for these tools. 

The solution I outline in this article integrates the 
IIS web log file, SQL Server 2005, SQL Server 2005 
Analysis Services (SSAS), SQL Server 2005 Integra- 
tion Services (SSIS), and SQL Server 2005 Reporting 
Services (SSRS). You can customize the cube or 
cubes to provide historical statistics and analyze 
many levels of usage. 


Step I: Create the Log File 

You create and configure the web log file via 
Site Properties, which you access through the IIS 
Admin tool, as Figure 1 shows. Or, if you don’t 
have access to the IIS Admin portal, you can use 
Web Sites properties, which you access from the 
Computer Management console in the Control 
Panel Administrative Tools applet. The log file that 
this step creates is a simple text file that can be read 
by third-party applications or opened in Notepad 
for manual review. The file has the following 
naming convention: C:\WINDOWS\system32\ 
LogFiles\ 


ORE on the WEB W3SVC{#}\ 


See the web figures and web ex{yymmdd} 
listings at InstantDoc ID 103424. log. 
Our office 


had used Analog 6.0 and Report Magic 2.21 for 
some time. This combination provides a good 
overall snapshot of the cumulative history of the site 
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through a web interface. So, instead of changing the 
log format or fields for my process, I left the config- 
uration at its default settings. Although the statistics 
logged are helpful, it can be hard to provide both 
the granular information and summarized data that 
the office would like to see from the simple text file. 
The reports from our other applications provided 
only basic OS and browser data. 

To enable logging on the IIS host, open the IIS 
Admin tool, expand the Web Sites tree, and right- 
click the Default Web Site. Select the Enable logging 
check box. Click Properties under Active log format, 
which is set to W3C Extended Log File Format, as 
Figure 1 shows. Click the Advanced tab to open the 
Logging Properties screen and select these fields: 
Date, Time, Client IP Address, User Name, Server 
IP Address, Server Port, Method, URI Stem, URI 
Query, Protocol Status, Protocol Substatus, and 
User Agent, as Web Figure 1 (www.sqlmag.com, 
InstantDoc ID 103424) shows. 


Step 2: Load the Data 
Next, you copy the log 
file to a location from 


where you can retrieve melon | oe k Custom Errors i ASP.NET 

3 r Performance ISAPI Fitters Home Directory Documents 

it. I decided to use DOS Peed rie es 

commands in .bat files Degorption: I 

run on the web server to — farer Z] Advanced. | 
TO port: [eo SA poet: | 443 


keep the process simple 
and to avoid having to 
install additional soft- 
ware. Our external web 
server didn’t run SQL 
Server and couldn't 
execute SSIS packages 
remotely. I created two 
batch files: Copy_log.bat, 
which Listing 1 shows, 
and Delete_log.bat, which 
Listing 2 shows. Copy_log 
.bat copies the log file 


Enable HTTP Keep-Alves 


F Enablelbopng — 
Actige tog format: 
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IIS WEB LOG CUBE 


to a directory on the web server so that 
you can use FTP to GET the file to your 
production database server. I set up a 
Windows Scheduled Task to execute the 


EX Delete Last Row 


L 


file on the web server on a nightly basis 


Execute Process 
S a 


A, truncate 
Gv) tblTreWebLog 


during the week. As an extra security ] 


| 


precaution, I scheduled the delete log 

A j aA, Truncate Aa Taas i Ben Te 
.bat file to run 15 minutes after copy. log LEV] thitretog Web Log Cube 
.bat runs to delete the file. This allows lm | | 
the FTP process to run on the SQL a9 E deleted ap R archive 

š i oad TreLo: US trewebLogArchive UF) thitrewebto 
Server system and copies the new file sia r iaei 
before it’s deleted. 
I created a nine-step SSIS package, Figure 2 


which Figure 2 shows, to load the file, 
parse the fields, archive the data, and pro- 
cess the SSAS cube. Before you begin cre- 
ating the package, execute the Table DDL file, which 
Web Listing 1 shows. This creates the destination tables 
(tblTreLog, tblTreWebLog, and tblTreWebLog- 
Archive) and stored procedure in a database to which 
you plan to connect the SSAS cube. 

To create your SSIS package, open Visual Studio 
2005. Then create the following tasks for your 
package. 

Execute process task. The first task of the 
package executes the TreLogFTP.bat file, which 


LISTING l: Copy_log.bat 


@ECHO OFF 


for 
set 
set 
set 
J| 

set 
set 


/f "tokens=2,3,4 delims=/ " %%i in ('date /t') do ( 
my_day=%%j 

my_month=%%i 

my_year=%%k 


my_year=%my_year:~2,4% 
fi leName=ex%my_year%%my_month%%my_day%. log 


copy "C:\WINDOWS\system32\LogFiles\ 
W3SVC1234567898\%Fi leName%" "C:\web\log" 


EXIT 


LISTING 2: Delete_log.bat 


@ECHO OFF 


for 
set 
set 
set 
) 
set 
set 
DEL 
EXIT 


/f "tokens=2,3,4 delims=/ " %%i in ('date /t') do ( 
my_day=%%j 

my_month=%%i 

my_year=%%k 


my_year=%my_year:~2,4% 
fi leName=ex%my_year%%my_month%%my_day%. log 
"C:\web\log\%fi1eName%" 


LISTING 3:TreLog FTP.bat 


@ECHO OFF 
REM 5/89/87 - David Pruden 
REM copy web log files from web site to load into tblTreLog 


ces JR EA 


REM delete old web log files 

DEL ex*.log 

REM connect to ww.website.com, get current files 

ftp -s:"C:\Program Files\Microsoft SQL Server\MSSQL\ 
Scripts\TreLogFTP.src" 127.9.0.1 

copy ex*.log TreLog. log 


EXIT 


An SSIS package 


LISTING 4:TreLogFTP.src 


[LOGIN] 
[PASSWORD] 
cd log 
prompt 
mget *.log 
quit 


LISTING 5: SSIS Task 2 


IF EXISTS C 
SELECT DATEPART(dw,GETDATE()) AS weekday 
WHERE DATEPART (dw,GETDATE()) BETWEEN 2 AND 6 
) 


BEGIN 
TRUNCATE TABLE tblTreLog 
END 


Listing 3 shows, to retrieve the web log file. The file 
is stored in C:\Program Files\Microsoft SQL Server\ 
MSSQL\Scripts\ along with the TreLogFTP. src file, 
which Listing 4 shows. To create this task, open the 
Visual Studio Toolbox, and drag the Execute Pro- 
cess Task to the Control Flow panel. Double-click 
the new task and click Process in the left panel, as 
Figure 3 shows. Click in the Executable field and 
browse to the TreLogFTP.bat file. Manually run 
copy_log.bat on the web server, then execute this 
step to make sure the .bat file copies the current file 
to your SQL Server system. You'll need the file to 
test and set up the third step. 

Truncate thlTreLog. The second task truncates the 
tblTreLog table. To create this task, drag an Execute 
SQL Task to the Control Flow panel. Connect the 
green connection arrow from the Execute Process 
Task to the SQL task. Double-click the SQL task 
and click Connection. Add a new connection to your 
destination database. Click the SQL Statement and 
enter the code for SSIS Task 2, which Listing 5 shows. 
We loaded data only Monday through Friday, so I 
added an IF Exists statement, as Figure 4 shows, to 
test the day of the week before truncating the table. 

Load TreLog. Next, add a Data Flow task. 
Double-click the task and drag a flat file source and 
an OLE DB destination to the Data Flow window, 
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as Web Figure 2 shows. Double-click the flat file 
source and add a new connection to the C:\TreLog 
log file. Under the Connection Managers tab at the 
bottom of the Visual Studio window, you'll see the 
new flat file connection. Double-click the connection 
and change the Header row to skip to 4, as Web 
Figure 3 shows. Click Advanced and change the 
Column 0 name to Entry and change the Output- 
Column Width to 4096. Connect the green connection 
arrow from the previous step to this one. 

Delete last row. Task 4 executes the delete_ 
tbITreLog_lastRow_SP code, which Listing 6 shows. 
This code deletes an unreadable character from the 
tblTreLog. Add a new Execute SQL Task to the 
Control Flow window, as Figure 5 shows. Connect 
the green connection arrow from the previous step 
to this one. 

Truncate thlTreWebLog. Add another Execute 
SQL Task for Task 5. This task simply truncates the 
tblITreWebLog table, clearing the log table that con- 
tains the previous day’s data. The table is used for the 
daily SSRS reports. Connect the green connection 
arrow from the previous step to this one. 

Load thITreWebLog. Task 6 executes some com- 
plicated SQL code to convert the single column data 
from Task 3 into specific columns. Add a new Data 
Flow Task and an OLE DB source and OLE DB 
destination. Double-click the OLE DB source and 
select SQL Command from the Data Access Mode, 
as Web Figure 4 shows. Add the SQL code for SSIS 
Task 6, which Web Listing 2 shows. Connect the 
green connection arrow from the previous step to this 
one. Because the flat file is neither delimited nor fixed 
width, the bulk of the work was writing a SQL query 
to parse out the data fields. I also had to convert the 
UTC time to Standard time. By using CHARINDEX 
and identifiable key patterns, such as .%.%.%. and 
%/%, you can break out the fields into the date, host 
IP, method, directory, port, source IP, browser, and 
status codes. 

Click Columns to preview the list of columns that 
the select code creates. Now connect the OLE DB 
source to the OLE DB destination and double-click 
the OLE DB Destination to add the tbITreWebLog 
to the Name of the table or the view field, as Web 
Figure 5 shows. Finally, click Mappings in the left 
panel to make sure the columns are mapped correctly, 
as Web Figure 6 shows. 

Delete old thlTreWebLogArchive records. Next, 
add a new Execute SQL Task and add the SSIS Task 
7 code, which Listing 7 shows, to the SQL statement. 
You can modify the date criteria to store either 
more or less data. Our office had seasonal rather 
than monthly trends. If you have a lot of site traffic, 
you might decide to keep less than a year’s worth of 
data. Connect the green connection arrow from the 
previous step to this one. 
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Execute Process Task Editor 
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Figure 3 


Retrieving the web log file 


Archive tblTreWebLog. Task 8 adds another 
Execute SQL Task that copies the daily data into an 
archive table (tblTreWebLogArchive). Add the code 
for SSIS Task 8, which Listing 8 shows. Connect the 
green connection arrow from the previous step to 
this one. 

Process the web log cube. The last SSIS task 
processes the cube that you'll create in Step 4: Build 
the Cube. (You must first build the cube before you 


LISTING 6: SSIS Task 4 


CREATE PROC delete tblTreLog lastRow SP 
AS 

DELETE FROM tblTreLog 

WHERE entry = '' 

OR entry LIKE '#%' 


J, Cofiase the properties reqared to mn SQL statements and taod procedines using Ce salted 
US) connection, 
54 
B Generel 
Purameter Macon Nore Truncate tbitretog 
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Clearing the staging table 
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Deleting an unreadable character from the tblTreLog 


LISTING 7: SSIS Task 7 


DELETE FROM tb1TreWebLogArchive 
WHERE logDateTime < dateadd(d, -365, getdate()) 


LISTING 8: SSIS Task 8 


INSERT 
SELECT logDateTime, 
hostIP, 
method, 
directory, 
port, 
sourcelP, 
browser, 
status, 
substatus 


FROM tb1TreWebLog 
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INTO tb1lTreWebLogArchive 


can add this step to the SSIS package.) Drag an 
Analysis Services Processing Task to the Control 
Flow window. Connect the green connection arrow 
from the previous step to this one. Double-click the 
Analysis Services Task and click Analysis Services. 
Click New next to the Analysis Services connection 
manager, as Web Figure 7 shows, and create a new 
connection to your cube. Click Add and navigate to 
your web log cube to select it for processing. 


Step 3: What to Analyze 

Originally, I had been loading the daily files so I 
could analyze potential threats or unauthorized 
activity. I created a few SSRS reports that search 
for key words, directories, or times. I was also able 
to get statistics on each directory’s hits. This worked 
well for the small amount 
of daily data. However, 
when the office wanted 
historical statistics by spe- 
cific dates and directories, 
the reports would take an 
extremely long time to gen- 
erate. The office wanted to 
be able to click an SSRS 
report and see it in seconds 
rather than minutes. I also 
wanted to be able to ana- 
lyze error codes over time 
as we made changes to our 
web applications. I decided 


to create a SSAS cube out of the archived data so that 
I could slice and dice it as needed. 


Step 4: Build the Cube 

I built the first cube on the archive table and included 
all the dimensions as well as the directory data as 
it was listed. This was too granular and contained 
too much information. It had all of the directories, 
subdirectories, files, and image files, in addition to 
bot data. 

The office just wanted to see the main directories 
as they related to the web layout. Using the code in 
Web Listing 3, I created a view that limits the data 
returned and counts the main directory and not the 
sub levels, as Web Figure 8 shows. I used the view as 
the fact table for the cube and also built the dimen- 
sions off the same view. I revised the cube to include 
only a Directory dimension and a Status dimension 
as well as two time dimensions. This saves extrac- 
tion, transformation, and loading time, and the cube 
processes in about 10 minutes. 


Step 5: Creating Reports 

In this last step, we create some SSRS reports from 
the cube data. I created one report with a graph that 
can be sliced and diced by date, month, year, and 
directory. This allows the office to see usage trends 
from a specific date that a press conference was held, 
an event was attended, or an advertisement was run. 
Over a year, we can see which month’s activity is 
low. I also created a pie chart to analyze directory 
hits and a third report that tracks error and status 
returns. You can view these reports in Web Figures 
9, 10, and 11. 


What’s Next? 

The next step would be to build a cube based on 
potential threats or bots. Creating a view that 
searches the URL for key words based on SQL injec- 
tion or that excludes all “good” URLs could be used 
to analyze threat trends over time. A bot or crawler 
cube could be helpful in predicting when the site is 
scheduled to be searched and by whom. If there’s site 
maintenance scheduled at a time when your site is 
crawled, it may be slower. 

The last key component would be building a 
translation table for the browser and OS data. Instead 
of displaying the cryptic information that’s captured 
in the log, the current version of a browser as well 
as the OS could be replaced with more user-friendly 
information. However, manually creating a reference 
table could be quite time-consuming. Attempting this 
with dynamic SQL could also be more of an academic 
exercise with results that would be more of a technical 
interest rather than a trends analysis or enhancement 
to threat detection. SQL] 

InstantDoc ID 103424 


SQL Server Magazine + www.sqlmag.com 


SQL Server Comparison 


and Synchronization Tools 
Manage the migration of database objects, 


code, and data 


hange is integral to modern business. Managing 

the migration of database objects, code, and data 
from development to staging and then from staging 
to production environments can be a tall order that 
consumes a lot of time, energy, and effort. Given how 
painful change management can be, a market has 
developed to provide tools and solutions that make 
detection and synchronization of change easier to 
tackle. 

Several solutions are available to provide differ- 
encing and synchronization of SQL Server objects, 
code, and data. In this article, Icompare Red Gate Soft- 
ware’s SQL Compare 8.1 and SQL Data Compare 8.1, 
The Australian Software Company’s SQL Delta 5.0, 
and ApexSQL Comparison Studio 2008. Additional 
comparison and synchronization solutions not dis- 
cussed here include Quest Software’s Toad for SQL 
Server (www.quest.com) and Idera’s SQL comparison 
toolset 1.2 (www.idera.com). 

I truly enjoyed evaluating the solutions from 
Red Gate, The Australian Software Company, and 
ApexSQL. Pitting these solutions against one another 
was a bit like test driving different Lamborghini 
models to determine which one I liked best. All three 
solutions have definite strengths, with no real flaws 
or weaknesses to speak of. Which solution is best is 
purely subjective and depends on your business needs 
and preferences. 


Putting the Solutions Through 
the Paces 

To put these tools to the test, I created a copy of one 
of my existing databases and made some deliberate 
changes to structure, code, indexes, and data. Then I 
turned each of the tools loose on a copy of the modi- 
fied database and the original to see how well each 
would do in terms of discovering differences, letting 
me slice and dice those differences, and, of course, 
how each of them fared in terms of managing syn- 
chronization of those differences. I was also concerned 
about accuracy—the ability of each solution to catch 
the changes I’d made. I was happy to see that all three 
solutions nailed that requirement right out of the gate. 
They all also fared well on the other key criteria I was 
looking at, which you can see in Table 1. 
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SQL Compare 8.1 and SQL Data 
Compare 8.1 

For many people, especially developers, Red Gate 
is almost synonymous with database comparison 
and synchronization. The company is considered the 
de facto leader within this space. I’ve been using SQL 
Compare and SQL Data Compare for over five years, 
so I enjoyed putting Red Gate’s solutions to the test 
from a competitive standpoint—not only to see how 
they stacked up against other offerings, but also to 
make sure I haven’t been missing something significant 
that another solution offers. 

The way SQL Compare and SQL Data Compare 
both save comparison details as a project is a big time 
saver and makes it easy to save connection details and 
comparison preferences for easy reuse in databases 
that are subject to frequent change and modification. 
SQL Compare and SQL Data Compare both also 
benefit from an intuitive UI that’s easy to interact with. 
(Figure 1 shows SQL Compare’s UL.) In addition, both 
products provide a great approach to synchronizing 
changes in the sense that they let you either generate a 
script to implement the changes or just run that script 
directly against the target database (or both). I also 
love that both SQL Compare and SQL Data Com- 
pare provide the option to recompare databases after 
synchronizing or pushing changes—I use this sanity 
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feature frequently, to make sure my changes went as 
planned and to ensure that I didn’t miss something. 

SQL Compare is probably the quickest of all the 
tools I evaluated. Although the other solutions weren’t 
far behind, I really noticed in a few cases just how fast 
SQL Compare is. SQL Data Compare seemed to be 
about as fast as the other data-comparison solutions 
I evaluated; I didn’t notice any big differences during 
comparisons. 

Overall, SQL Compare and SQL Data Compare 
both work as advertised; they are solid, robust, cost- 
effective tools. Both applications have well-polished 
UIs that let you quickly slice and dice differences to 
easily evaluate and isolate changes from one database 
to another. In addition to working with SQL Server 
databases, SQL Compare and SQL Data Compare 
can both work with SQL Server backups, which 
expands the tools’ change auditing and granular data 
recovery abilities in case of a disaster. 

Another strength that both tools offer (and that 
often goes overlooked) is the Pro versions’ sup- 
port for command-line interactions. Command-line 
capabilities let you create scripts or batch files that 
business users can use to push metadata (e.g., pricing 
information for products that are going on sale) from 
a test or quality assurance server out to production 
servers without requiring DBA interaction. All DBAs 
need to do is set up the types of data changes allowed 
or targeted, then set up scripts for business users or 
QA folks to run when the need arises (and after data 
has been validated). In addition to highlighting how 
versatile these tools can be in the war on herding data, 
the benefits of this feature alone can easily pay for the 
cost of SQL Data Compare. 

The only drawback I noticed with SQL Compare 
and SQL Data Compare is that they’re two separate 
tools. Ideally, I wish the two tools were combined into 
a single application. Having them both be part of the 
same application would make sense, as in SQL Delta. 


SQL COMPARE 8.1 AND SQL DATA 
COMPARE 8.1 


Pros: Cost-effective, fast, and intelligently designed UI; these tools 
boost productivity and save time and effort 


Cons: Two separate applications for object comparison and data comparison; 
Red Gate’s SQL Comparison Bundle is well-priced but doesn’t include the Pro 


Tools option 


Rating: KAKAK 


Price: $395 each for standard SQL Compare and SQL Data Compare; $595 
for Pro versions; Standard versions are included in SQL Comparison Bundle, 
along with SQL Packager and SQL Dependency Tracker, for $695; Pro ver- 
sions are included in SQL Toolbelt for $1,995; volume discounts available 


Recommendation: Solid and well-designed tools that will quickly pay for them- 
selves; definitely worth a download and trial. Bundles provide excellent value. 


Contact: Red Gate Software e 866-997-0379 © www.red-gate.com 
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SQL Delta 5.0 

Out of the box, one of the things that helps set SQL 
Delta apart from the competition is its great UI— 
which is especially impressive because neither of its 
competitors are slouches in this regard. Initially, I 
was a bit skeptical of the fact that SQL Delta uses the 
new Microsoft Office Ribbon (see Figure 2) to drive 
user interaction and manage options, navigation, 
examination, and synchronization. But it took only 
a few minutes of using SQL Delta to become hooked 
on its well thought out and intuitive use of Ribbon 
functionality. In fact, in addition to allowing very 
logical interaction with objects and filtering options, 


Pitting the three solutions 
against one another was 
like test driving different 
Lamborghini models to 
determine which one | 
liked best. All the solutions 
have definite strengths, 
with no real flaws or 
weaknesses. Which solution 
is best is subjective and 
depends on your business 
needs and preferences. 


SQL Delta also leverages Ribbon functionality to 
intelligently and seamlessly allow object and data 
comparisons to exist within the same application. 

As with Red Gate’s approach, SQL Delta orga- 
nizes connection details and preferences (or com- 
parison settings) into projects or project files. But 
because these projects already contain connection 
details and comparison preferences, the SQL Delta 
UI makes it easy to take comparisons to the next 
step by allowing you to quickly and intuitively define 
comparison settings for additional data you want to 
evaluate. 

I was impressed with SQL Delta’s user experi- 
ence regarding synchronization. I’ve always liked 
Red Gate’s synchronization wizard, but SQL Delta 
seems to magically accomplish the same task with 
fewer mouse-clicks—while still providing all the 
features and options I’ve grown to require from 
Red Gate. 
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SQL Delta also gets bonus points for making it 
patently obvious that my databases were running in 
compatibility mode—something that neither Red 
Gate nor ApexSQL make abundantly clear. Like- 
wise, while testing filtering logic, I was impressed 
that even when I told SQL Delta to ignore differ- 
ences in indexes, it still reported that my primary 
keys (on one table with a composite, clustered, pri- 
mary key) were different. Red Gate and ApexSQL 
both missed this fact, which kind of floored me. (It’s 
true that I told Red Gate and ApexSQL to ignore 
indexes, but indexes are hardly the same as primary 
keys.) 

SQL Delta also did a great job with the size of 
database I was working with. Like its competitors, 
the application churned through an 8GB table fairly 
quickly, and it easily managed memory without 
ballooning up. In terms of both features and perfor- 
mance, the product can definitely hold its own. 

Unfortunately, SQL Delta is missing some of 
the features that both of its competitors sport, such 
as support for interrogating source control, using 
backups, or creating and using snapshots. In that 
regard, it falls behind both of its competitors. 

However, SQL Data’s price more than makes up 
for the features it lacks—the application is about half 
the price of the other solutions. If you don’t need the 
additional features or capabilities, then SQL Delta is 
an attractively priced option that packs a powerful 
engine, a great UI, and some excellent capabilities into 
a single, tidy package. 

Overall, Pm impressed with SQL Delta. Its 
pricing, feature set, and capabilities make it very 
competitive. 


SQL DELTA 5.0 


Pros: Well-designed and easy to use; 
cost-effective and competitively priced; combines 
object and data comparison features into a single 
application; excellent at-a-glance synchronization 
options 


Cons: Missing some extended features (e.g., 
source control, backup integration) that other 
solutions provide—but priced accordingly 


Rating: Aká 
Price: $330; volume discounts available 


Recommendation: SQL Delta is a great applica- 
tion, with solid core features. It’s well thought out, 
performs admirably, and gets the job done. It’s 
definitely worth an evaluation if you don’t need 
integration with source control or some of the 
more advanced features. 


Contact: The Australian Software Company ¢ 
+61 2 9267 5366 © www.sqidelta.com 


SQL Server Magazine + www.sqimag.com 


ee NES 
-#- Trasar =)> * {Re 
28% a5>3- 
on gow on OSes Beam™in™ iwas Owe 
sans aosta a tee 


1e nas degn 


RASA LA roest Mote) G oy ag 


wam Omen ep e Mota jh eee D) Putas MI |O 


ORES OVA se en ae 


£ 


Figure 2 
SQL Delta’s Ribbon UI 


ApexSQL Comparison 

Studio 2008 

ApexSQL has been in the comparison and synchro- 
nization game for a while. I’ve used their products 
in the past, and I have several colleagues who swear 
by ApexSQL Comparison Studio. Consequently, 
I expected them to be a strong performer—and I 
wasn’t disappointed. 

ApexSQL takes the same approach as Red Gate, in 
which separate applications are used instead of rolling 
everything into a single application like SQL Delta 
does. Also similar to Red Gate’s model, you can pur- 
chase ApexSQL Comparison components separately 
or as part of a bundle. Unlike either of its competitors, 
ApexSQL provides APIs that allow developers to 
fold comparison and synchronization capabilities 
into their applications—offering some powerful capa- 
bilities and options for common or recurring change 
management. 

In terms of comparison and filtering capabilities, 
ApexSQL Comparison Studio 2008 and its components 
can definitely hold their own when compared with SQL 
Delta and the Red Gate products. As you can see in 
Figure 3, ApexSQL solutions take a different approach 
to displaying results than either Red Gate or SQL 
Delta. I’ve used Red Gate for several years, so I initially 
struggled a bit with how ApexSQL handles the display 
of differences. However, I’m not sure ApexSQL’s 
approach is any better or worse—it’s just different. 

In terms of the overall UI, ApexSQL’s interface is 
more Spartan than the other solutions. Because I tend 
to prefer a flashier UI, I wasn’t as drawn to this one 
as I was to the others. However, in a couple of cases 
I noticed that ApexSQL’s more basic approach made 
it much easier for me to visually notice differences. 
Even when the same functionality existed in the other 
apps, the visual clues weren’t as obvious because they 
blended in better with the glitzier UIs. 
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TABLE |: Continued 


Collations Y Y y 
Extended Properties Y ? Y 
SET Statements* Y Y N *Some SET options, not all. 
Permissions if Y if 
Ignore Options (Data) 
GUIDs N Y y 
Case if Y Y 
Timestamps N Y Y 
Trailing Spaces if N Y 
Binary Data N Y Y 
Synchronization Options 
Dependency Detection* Y Y Y *Ensures that objects/changes are modified in correct order. 
Validations/Warnings* Y N Y *Check for potential scripting/synchronization errors. 
Pre-Sync Backup Option Y YE Y *Warning: unlike other solutions, which will execute backup. 
Scripts Y Y Y 
Execute Y Y Y 
Compare after Sync Y y N 
Reports 
HTML Y Y y 
XML Y N y 
Excel Y N N 
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ApexSQL’s approach to setting up and storing 
project details was the least intuitive of the solutions 
I evaluated. In fact, this feature borders on being a 
liability. In addition, ApexSQL Diffs and ApexSQL 
Data Diffs synchronization interfaces weren’t as 
robust as their competitors’. Although ApexSQL’s 
synchronization process contains all the necessary 
elements for successful synchronization (including 
warnings and validations), it’s less intuitive and more 
cumbersome than the other solutions’ synchronization 
experiences. I do prefer the fact that ApexSQL lets you 
change scripting options on a per synchronization basis 
(as opposed to per project); this option gives you more 
granularity in managing synchronization efforts. 

One area in which ApexSQL Comparison Studio 
2008 leaves its competitors in the dust is comparison 
of SQL Server Integration Services (SSIS) packages. 
ApexSQL SSIS Compare lets you dig into every facet 
of your SSIS packages and enumerate every possible 
setting or configuration detail. Although ApexSQL 
SSIS Compare doesn’t synchronize packages, it’s still 
a great feature for organizations that depend heavily 
on SSIS and extraction, transformation, and loading 
(ETL), and it can be a lifesaver when troubleshooting 
packages and validating changes. Both of ApexSQL’s 
competitors lack this powerful option. 

ApexSQL Comparison Studio 2008 offers compel- 
ling strengths and benefits. It’s a strong competitor for 
both Red Gate and SQL Delta. 


APEXSQL COMPARISON 
STUDIO 2008 


Pros: Cost-effective; better customization 
and integration than competing solutions; 
ApexSQL SSIS Compare is a powerful feature 
that competitors’ bundles don’t include 


Cons: Although ApexSQL’s comparison options 
are more flexible than competing solutions, they 
are more difficult to configure and manage; 
needs a better UI for making quick data 
comparisons in just a table or two 


Rating: KAKAK 


Price: $299 each for ApexSQL Diff, ApexSQL 
Data Diff, and ApexSQL SSIS Compare; $599 
for ApexSQL Diff API; $299 for ApexSQL 
Script; ApexSQL Comparison Studio includes all 
solutions for $699; attractive maintenance and 
renewal fees 


Recommendation: ApexSQL Comparison Studio 
is a great deal and includes competitive tools 

and options not found in competing solutions. 
Although the data comparison UI needs a bit of 
work, this fantastic solution is definitely worth a 
download and evaluation. 


Contact: ApexSQL ° 919-968-8444 e 
www.apexsq!.com 
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Figure 3 
ApexSQL Diff's window for displaying differences 


Eenie, Meenie, Miney, Mo... 

All three of the solutions I reviewed are competi- 
tive in terms of features, capabilities, performance, 
and ability to improve productivity. Consequently, 
pricing and bundling of solutions play a big role in 
determining which solution might best meet your 
needs. 

Red Gate’s SQL Compare and SQL Data Com- 
pare are $395 each. Pro versions of each product are 
$595, providing command-line interactions, support 
for source control, and other benefits. You can also 
buy both tools bundled together with SQL Depen- 
dency Tracker (a phenomenal tool in its own right) 
and SQL Packager for $695. (This bundle doesn’t 
include the Pro versions of SQL Compare and SQL 
Data Compare, which makes me wish that Red Gate 
offered a Pro Comparison Bundle for $895.) 

ApexSQL’s products are similarly priced. Apex- 
SQL’s Comparison Studio is $699 and includes core 
differencing components, a packaging solution, APIs, 
and ApexSQL SSIS Compare. You can also purchase 
components separately, at $299 each. 

Red Gate’s and ApexSQL’s bundles are great 
values, but SQL Delta is also competitively priced. 
It’s a cheaper overall solution, albeit with fewer 
features—but it’s a steal if you don’t need some of 
Red Gate’s or ApexSQL’s more advanced features and 
capabilities. 

All three solutions will help you save significant 
time, so they'll quickly pay for themselves. If you 
don’t already have a comparison and synchronization 
solution, you should get one. Each of the solutions 
I reviewed is available for a minimum 14-day trial. 
Because each solution has strengths and benefits, 
I recommend that you try them all to determine 
which one best meets your organization’s long-term 
needs. If you’ve been managing differences manually 
or through scripts, any one of these solutions will be 
a huge improvement. 
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TABLE I: Comparison and Synchronization Options 


Supported SQL Server Versions 


2008 Y y 
2005 y 
2000 Y 
Comparison Sources 
Live Database if if y 
From Backup Pro Y Vf? *For Data Diff only. 
From Snapshot* y Y Y *Great for auditing and reviewing historical changes. 
From Scripts Folder Pro N Vf 
From Source Control Pro N Yy 
Object Comparisons 
Users/Roles Y y Y 
Standard Objects* vf Vf Yy *Tables, views, sprocs, UDFs, triggers, UDTs, defaults, rules, etc. 
Encrypted Objects Y N N 
CLR Assemblies if Y Vf 
Notification Services if Y Yy 
XML Schema Y if Vf 
Partitioning Schemes/Functions Vf Y Vf 
DDL Triggers Vf N Y 
Full Text Indexes Y if Yi 
Full Text Stop Lists y Y N 
Plan Guides N Y N 
Features 
Extensive/Customizable Filters Y if Y 
Command Line Pro Y Y 
APIs N N 
SSIS N N VE *Requires SQL Compare Suite or SSIS Compare. 
Check Sum Data Comparisons* Y N N *Can be used to speed up data comparisons. 
Ignore Options (Objects) 
ANSI Options N N Vf 
Whitespace y Y y 
Comments Y Y Y 
CHECK/NO CHECK y Y N 
Case Y if y 
Column Order Y if Vf 
Constraints Y y Y 
Data Compression Options if i N 
Trigger Order y N N 
Statistics Y if y 
Indexes if Y Yi 
Identity Seed/Increment Y Y if 
Fill Factor/Index Padding Y if Y 
Index/Constraint Names if Y y 
Full Text Indexes Y y Y 
File Groups/Partitions if ? VE *Filter (instead of comparison option). 
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TABLE |: Continued 


Collations if Vf Yi 
Extended Properties if 1 Y 
SET Statements* Y if N *Some SET options, not all. 
Permissions Y Y if 
Ignore Options (Data) 
GUIDs N y Y 
Case Y Y Y 
Timestamps N if Y 
Trailing Spaces Y N Y 
Binary Data N Y Yy 
Synchronization Options 
Dependency Detection* Ni Y Y *Ensures that objects/changes are modified in correct order. 
Validations/Warnings* Y N Y *Check for potential scripting/synchronization errors. 
Pre-Sync Backup Option if Nie Y *Warning: unlike other solutions, which will execute backup. 
Scripts Y Vf if 
Execute Y Y if 
Compare after Sync Y if N 
Reports 
HTML Y y. y 
XML Yi N y 
Excel if N N 
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Staying Abreast of SQL Server 
Database Trends in 2010 


hat trends should enterprises be watching in 
2010, and how will they affect an organization’s 
security strategies? Slavik Markovich, CTO and founder 
of the database security company Sentrigo (sentrigo 
.com), thinks IT groups should pay attention to the cloud, 
virtualization, and a growth in hacking tools. On the con- 
sumer level, Slavik noted that 2010 could be the first year 
that Apple computers experience a major virus attack. 
“There’s a big misconception from Mac owners that 
Macs and iPhones are secure,” he said. “An iPhone has 
an IP address—already there have been a few worms.” At 
work, people just open their mobile devices and connect 
to the PC or to a service. Slavik recommends that enter- 
prises think hard about how to protect those endpoints. 


2010: Data Moves to the Cloud 
According to Slavik, the “biggest push in 2010 is the 
move to cloud-based services. Microsoft will push 
the Azure cloud platform and SQL Azure database 
services.” A major hurdle will be protecting the data in 
the cloud environment, whether from outside attacks 
or from your own data administrators, cloud adminis- 
trators, or administrators from the hosting company. 
“How do you trust them? Or trust but verify that your 
data is not being accessed or breached?” Slavik asks. 
“And how do you monitor access to the information 
while it’s kept in the cloud?” 

Slavik notes that DBAs have been slow to move 
data to the cloud because the market hasn’t been 
ready. “There werent good services out there that 
offered real SQL Server hosting. What you got from 
Amazon [for example] for their cloud was just basically 
the platform. And Google provided its own database. 
Smaller companies provided the SQL Server envi- 
ronment, but didn’t provide the whole vision thing. 
Whereas Microsoft with Azure provides a really strong 
platform that offers both platform services and higher- 
level services—SQL Server web services and a path 
between them.” For more on Azure Database Services, 
see Mike Otey’s “7 Facts about SQL Azure” (www 
sqimag.com, InstantDoc ID 102766). 


2010: Time to Virtualize 

While virtualization has been a big trend in 
2008 and 2009, Slavik looks to 2010 as the time 
when things really ramp up. “You won't see any 
organization without some virtualization. The push will 
be for backend service virtualization, which includes 
database virtualization. Up until now, organizations 
were hesitant about putting databases inside virtual 
machines (VMs), but I see more and more customers 
putting SQL Servers and Oracle databases on VMs.” 
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He attributes the openness to virtualization to the 
maturity of the platforms. On the security side, chal- 
lenges he calls out are the dynamic nature of the envi- 
ronment and changes to traditional security models. 


2010: Hacker Proliferation 
The security game changer for Slavik is the variety 
of new tools, courtesy of the hackers, that enable 
automated random attacks on data. “Getting from a 
vulnerability to an exploit is going to be very easy for 
hackers, especially when you talk about databases and 
patching. Once a vendor releases a patch, we might 
see worms that immediately try to exploit the patched 
vulnerability. Hackers know that enterprises out there 
just don’t patch as quickly as they should.” 
According to Slavik, money is the big motivator. 
“Tt’s all about economics. There’s a lot of money to 
be made hacking into companies and stealing credit 
card information. This motivates organized crime, 
too. It’s not just the super-skilled hackers. Anyone can 
download those tools.” SQL 
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(smolnar@ sqlmag.com) is executive editor, 
developer content, for the magazines and 
websites SQL Server Magazine, System iNEWS, 
and DevProConnections.com. Formerly, she 
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Microsoft. 
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O Editor's Tip 


Got a great new product? 
Send announcement to DATABASE ADMINISTRATION 


products @ sqlmag.com. Idera Announces Diagnostic Manager 6.1 
—Brian Reinholz, Idera announced the latest version of SQL diagnostic manager. The new release features 
production editor enhanced replication environment monitoring and new cluster and deadlock monitoring 
capabilities. SQL diagnostic manager 6.1 offers 
the following features: cluster monitoring 
(eliminates the need for an additional 


tomes lege 


& a < 2 cluster monitoring solution for SQL Server), 

mor TE socane ! deadlock monitoring (alerts and provides 

= EENET = es details to DBAs when deadlocks occur), and 
x circa frome tates gå Mee mm" | enhanced replication monitoring (a single view 
peta = se ee et Ba 4 "oa OSISE] providing replication performance metrics). 
Fels = —— SQL diagnostic manager is compatible with 

on : me .| SQL Server 2000, 2005, and 2008, and is 


priced at $2,049 per instance. A free 14-day 
trial is also available at www.idera.com. 
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yg ; ectiaghe MVP Systems Releases JAMS 4.9 


reen tree va O HM. 


Banu ok MVP Systems announced the general avail- 
amin .| ability of JAMS 4.9, its enterprise job scheduling 
aca solution. JAMS 4.9 makes it easier to control 

automated tasks with a variety of new features. 
Highlighted features include: a customizable GUI allowing multiple views from the same window, 
push installation for the Windows Agents in JAMS, automatic updates to the schedule, and the 
ability to trigger job chains based upon event triggers. A trial version of JAMS 4.9 is available for 


download at www.jamsscheduler.com. 
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SQL Sets Organizes and Simplifies 
OB Open set D ien smpe set æ La į 
ae d eTa e a T Os om sh SQL server Work 
— st ERE Mike Morris has released SQL Sets 1.5, the latest 
| E eererh set 1 x š 7 A å 
——<—— -A version of the program that simplifies sharing SQL 
paperan “hae Server data with non-technical users. According 


IF bol i Je Soportais (1 


2 hte 6 n Hin] ebo-Arennmexetvers 0) to the product’s creator, “SQL Sets makes it easy 
to quickly capture and organize query-based 
snapshots of your SQL Server data into a single, 
self-contained file called a Portable Data Set 
do Brent (0) Document that can then be saved, shared, com- 
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= = [a onen pared, and annotated.” SQL Sets costs $149, or you 
amas “eis pea a aaao can download a free trial at www.sqlsets.com. 
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Secerno Updates Threat-Blocking Solution 
Secerno announced the release of Secerno 
DataWall 4.1, which offers real-time threat monitoring and blocking. DataWall 4.1 can monitor up to 
230,000 transactions per second. DataWall can also block all out-of-policy database access, including 
access given to privileged users, to provide immediate protection against internal threats. In addition 
to preventing malicious actions, DataWall’s monitoring also ensures employees act within regulations 
such as PCI, SOX, and HIPAA. Other features include: support for SAN arrays and 10 Gbps network 
deployments, an automated remote upgrade process, optional strong cryptography pack, and DB2 for 
z/OS beta initiated. To learn more, visit www.secerno.com. [SQL] 
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Converting Data Types 


Michael Otey 


(motey@ sqlmag.com) is technical director 
for Windows IT Pro and SQL Server Maga- 

zine and author of Microsoft SQL Server 
2008 New Features (Osborne/McGraw-Hil). 


QL Server 2008 introduced welcome and long- 

overdue data types, including the new date, 
time, and datetime2 data types. However, to take 
advantage of these new data types you'll likely 
need to perform some conversion to and from your 
existing datetime data types. The code below shows 
how, with output examples shaded in blue. 


Convert from datetime to 
date 

In this conversion, the year, month, and day in the 
datetime data type are copied, but time values in 
the datetime data type are ignored. 


DECLARE @date date, @datetime datetime 
SELECT @datetime = GETDATE(), @date = @datetime 
SELECT @date AS 'date', @datetime AS 'datetime' 


2010-01-11 2010-01-11 15:40:14.510 


Convert from datetime to 
time 

Here, hours, minutes, seconds, and subseconds are 
transferred to the time data type. Fractional sub- 
second time values over three digits are truncated. 
Date values in the datetime data type are ignored. 


DECLARE @time time, @datetime datetime 
SELECT @datetime = GETDATE(), @time = @datetime 
SELECT @time AS 'time', @datetime AS 'datetime' 


15:42:36.7100000 2010-01-11 15:42:36.710 


Convert from datetime to 
datetime2 

This conversion is straightforward: Both the date 
and time of the datetime data type are copied. 


DECLARE @datetime2 datetime2, @datetime datetime 
SELECT @datetime = GETDATE(), @datetime2 = 
@datetime 

SELECT @datetime2 AS 'datetime2', @datetime 
AS 'datetime' 


2010-01-11 15:44:57.85 2010-01-11 15:44:57.853 


Convert from time to 

datetime 

Hours, minutes, seconds, and subseconds are converted 
and fractional subsecond time values over three digits 
are truncated. The datetime data type’s date value is set 
to 1900-01-01. 


DECLARE @time time(4), @datetime datetime 
SELECT @time = '10:11:12.1234', @datetime = 
@time 

SELECT @time AS 'time', @datetime 

AS 'datetime' 


10:11:12.1234 1900-01-01 10:11:12.123 


Convert from date to 
datetime 

The date values in the date data type are converted, 
but the time portion of the datetime data type is set 
to zero. 


DECLARE @date date, @datetime datetime 
SELECT @date = '@1-11-10', @datetime = date 
SELECT @date AS 'date', @datetime AS 'datetime' 


2010-01-11 2010-01-11 00:00:00.000 


Convert from datetime2 to 
datetime 

Here, the date and time portion of the datetime2 data 
type are copied to the datetime data type, but fractional 
subsecond time values greater than three digits are 
truncated. 


DECLARE @datetime2 datetime2, @datetime datetime 
SELECT @datetime2 = GETDATE(), @datetime = 
@datetime2 

SELECT @datetime AS 'datetime', @datetime2 

AS 'datetime2' 


2010-01-11 15:50:56.617 2010-01-11 15:50:56.61 
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VISUAL STUDIO MICROSOFT DAY 


VMS01: ADVANCED DEVELOPMENT 
PRACTICES-BUILD AUTOMATION AND 

TEST LAB MANAGEMENT WITH 

VISUAL STUDIO 2010 

MICROSOFT 

Successful software projects require regular valida- 
tion and verification of the code you're writing and 
early feedback if a defect is found. In this session, 
you'll learn how you can use the build automation 
capabilities in Visual Studio Team Foundation Server 
2010 to define and execute regularly scheduled 
builds and continuous integration builds that vali- 
date check-ins before committing them to the main 
repository. You will see how to define a build work- 
flow that validates the code and verifies the soft- 
ware, including build verification tests and architec- 
tural compliance validation. We'll also show you how 
to incorporate the new Visual Studio Team Lab 
Management 2010 capabilities to enable testing the 
output of a build in a virtualized test environment, 
enabling you to more thoroughly verify the software 
and share the environment in the event of a bug. 


VMSO02: CODE UNDERSTANDING 

AND SYSTEMS DESIGN WITH 

VISUAL STUDIO 2010 

MICROSOFT 

Visual Studio 2010 introduces an entirely new set of 
architecture tools to aide in both understanding the 
code you already have and in defining how new sys- 
tems will be built. In this session, you will discover 
how you can use new tools like the Architecture 
Explorer to better understand and digest complex 
systems before making any changes to them. You will 
see how graphically modeling the code makes it eas- 
ier to understand the impact of a potential change. 
We'll also show you how you can use modeling tools 
for UML and layer diagramming to describe and com- 
municate the design of a new system-including how 
these tools can be used to verify the software being 
developed against its intended architecture. 


VMSO3: IMPROVING DEVELOPER-TESTER 
COLLABORATION WITH VISUAL STUDIO 2010 
MICROSOFT 

An effective collaboration between developers and 
testers is paramount and can make the difference 
between shipping quality applications on time, or 
slipping because bugs are found late. In this session, 
we'll show you how developers and testers benefit 
from integrated tools throughout the development 
lifecycle. We'll show you how test case management 
tools aide in creating and organizing test cases, how 
IntelliTtrace™ can be used to replay application exe- 
cution history, and how actionable bugs can be cre- 
ated when using the new Microsoft Test and Lab 
Manager to benefit both developers and testers. 


4 | Register Today! Call 800-438-6720 | www.DevConnections.com 


VMS04: PROACTIVE PROJECT 
MANAGEMENT WITH VISUAL STUDIO 2010 
MICROSOFT 

More and more often project managers are being 
deeply integrated into development teams, and agile 
methodologies such as Scrum are taking hold in 
mainstream development. In this session, we'll 
explore how project managers can leverage the 
capabilities of Visual Studio 2010 to manage, com- 
municate, and track work to be done as well as 
report on project status and key performance indi- 
cators through the project lifecycle. We'll demon- 
strate the new Agile Planning workbooks in Visual 
Studio 2010, showing you how to take advantage of 
these tools in your current and future projects. 


VMSO5: SHAREPOINT AND OFFICE 
DEVELOPMENT WITH VISUAL STUDIO 2010 
MICROSOFT 

Many customers are turning to SharePoint as a way 
of meeting changing business needs and managing 
IT costs and complexity. Visual Studio 2010 provides 
new support for SharePoint 2010 development, 
including tooling for Web Parts, Lists, Workflows, 
Events and more, so you can bring great new cus- 
tomized collaboration tools to your company. This 
session will also cover building the core information 
worker assets that SharePoint sites manipulate 
through custom development on Microsoft Office. By 
using a platform that is readily familiar to users, 
developers can dramatically decrease the acquisi- 
tion times for business applications while providing 
increased functionality. 


VMS06: TEAM FOUNDATION SERVER 2010 
FOR EVERYONE 

MICROSOFT 

New for Visual Studio 2010 with an MSDN 
Subscription is the provision of a Team Foundation 
Server 2010 license with all levels Professional and 
above. This brings the enterprise quality team col- 
laboration server to all professional developers. In 
this session, we'll look at the new options for run- 
ning Team Foundation Server 2010 on your client or 
server, and how you can use it to improve your 
source code management, build, versioning and 
work item tracking processes. If you or your team 
is using Visual SourceSafe today, come to this ses- 
sion to see how to improve the level of collabora- 
tion so your team can focus on turning ideas into 
impactful solutions. 


VMSO7: WEB AND CLOUD DEVELOPMENT 
WITH VISUAL STUDIO 2010 

MICROSOFT 

What types of applications would you build with 
instant scalability, automatic management, and a 
standards-based platform at your fingertips? In this 


session, we'll show how Visual Studio 2010 delivers 
on the vision of building Web and cloud applications 
through improved designers, simplified deployment, 
integrated project templates and new debugging 
experiences. We'll also show you how you can use the 
IDE to improve your productivity in building unit 
tests, creating MVC applications and using industry 
standard functionality like jQuery. 


VMSO8: WINDOWS DEVELOPMENT WITH 
VISUAL STUDIO 2010 

MICROSOFT 

Building Windows applications has never been easier 
than with Visual Studio 2010. In this session, we'll 
show you how designers and developers benefit 
from powerful design surfaces and a seamless work- 
flow that enables the creation of compelling rich 
user experiences for Windows applications. We'll 
explore the great new tool and platform support in 
Visual Studio 2010, including multi-touch and “rib- 
bon" Ul components and show how that will put you 
out in front of the Windows 7 wave and make build- 
ing Windows and Rich Internet Applications easier 
and faster than ever. 
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VLV200: .NET ROCKS! LIVE AT THE VISUAL 
STUDIO 2010 LAUNCH 

CARL FRANKLIN AND 

RICHARD CAMPBELL 

Listen to Carl and Richard talk to industry experts, 
recorded live at the Microsoft Visual Studio Launch 
conference and expo. See website for announcement 
of the guest. 


VWPO1: A SIMPLE UI SHELL FOR 

XAML APPLICATIONS 

ROCKFORD LHOTKA 

With every new UI technology it is necessary to find 
coding patterns that enable user navigation and 
interaction. In the past we've seen SDI and MDI mod- 
els, and applications that are modeled after 
Microsoft Outlook, Microsoft Money and others. And 
we've seen things like composite UI frameworks, 
including the Prism framework. In this session, you 
will learn several basic concepts and techniques you 
can apply when designing and building Silverlight 
and WPF applications that enable flexibility in your 
overall application shell implementation. While build- 
ing a complete UI framework is no small task, even 
the simplest applications can benefit from the con- 
cepts and techniques covered in this session. 


VWPO2: BUILDING A WPF UI IN 

VISUAL STUDIO 2010 

ROCKFORD LHOTKA 

Visual Studio 2010 provides a powerful XAML design- 
er you can use to build compelling user interfaces for 
Silverlight and WPF applications. In this session, you 
will learn about the exciting capabilities of the new 
designer and how you can use it to perform UI layout 
and set up data binding. This new designer brings 
XAML development in close parity to Windows Forms, 
and really shows the promise and capabilities of the 
WPF and Silverlight technologies. 


VWPO3: BUILDING DATA VISUALIZATION 
APPLICATIONS WITH WPF & SILVERLIGHT 
TIM HUCKABY 

This session will be heavily demo-focused to accen- 
tuate how the power of the Windows Presentation 
Foundation (WPF) and Microsoft Silverlight can be 
used to visualize data to produce amazing software. 
WPF is the next-generation presentation sub-system 
for Windows. Silverlight is a broad reach subset of 
WPF that runs cross platform in the browser. These 
two XAMLbased developer technologies provide 
developers and designers with a unified program- 
ming model for building rich Windows client and RIA 
(Rich Internet Application) user experiences that 
incorporate Ul, media, and documents. WPF and 
Silverlight use vector-based graphics rendering, 
which results in better graphics and presentation for 
an application. WPF and Silverlight also have other 
consistent features such as layout, styling, and data 
binding, which, when you mix with interactivity, 
enables scenarios such as interactive data visualiza- 


tion. When you put all this together, you have a uni- 
fied API for various presentation components, such 
as 2D and 3D documents and declarative program- 
ming through XAML, which is a powerful platform for 
data visualization that can be used to really “light- 
up” you enterprise and Internet applications. These 
XAML-based developer technologies are manifested 
in three major application platforms (Windows Client 
(WPF), Silverlight and Microsoft Surface) and all will 
be covered in this session at some level. 


VWPO4: GENERATING DYNAMIC UI IN 

WPF 4.0 

BILLY HOLLIS 

Creating user interface elements on the fly is much 
easier in WPF and Silverlight because they are XAML- 
based UI technologies. Using LINQ over XML, XAML 
generation is cleaner and more flexible than earlier 
dynamic UI options. This capability is invaluable in 
many applications, including healthcare, educational 
testing, generic data entry programs, and many 
other scenarios. This session will lay down a basic 
framework for dynamic Ul, including generation of 
XAML on the fly and how to do dynamic loading of 
XAML into a running UI. 


VWPOS5: INTEGRATING WPF & WCF INTO 
YOUR OFFICE BUSINESS APPLICATIONS 
TIM HUCKABY 

This session will highlight many of the ways that the 
Windows Presentation Foundation (WPF) and the 
Windows Communications Foundation (WCF) can be 
leveraged in Office applications built with Visual 
Studio 2010 Tools for the Office System (VSTO). 
Visual Studio 2010 offers an array of new features 
aimed at a wide range of Office solution types. With 
Visual Studio 2010, you can build solutions that 
incorporate the native capabilities of the Office 
client applications (like Outlook) combined with the 
sophisticated Ul capabilities of WPF that's connect- 
ed to remote data and services via WCF and use the 
RAD features of LINQ to manipulate that data. These 
new technologies provide opportunities for building 
powerful solutions with functionality that was previ- 
ously difficult or impossible to achieve. Now that 
Office has evolved into a true development plat- 
form, Office-based solutions are becoming increas- 
ingly sophisticated, less document-focused, and 
more loosely coupled. This session will show you 
how easy it is to build robust solutions that leverage 
the latest technologies. 


VWPO6: JUMP INTO WPF! ...AND BECOME 
IMMEDIATELY EFFECTIVE 

TIM HUCKABY 

You've seen the beautiful animated user interfaces; 
you have seen the gratuitous animations; you have 
seen the 3D. You might not be doing it now, but you 
will do it eventually. You will be building rich client 
applications in WPF. It is just a matter of time. This 
session was designed as an introduction to WPF to 


get you over that big learning curve that has frus- 
trated many and well on your way to building great 
applications in WPF. In this session, you'll learn how 
to use Visual Studio 2010 to help build WPF applica- 
tions, of course. But, also in this session, you'll learn 
a number of tools you will use to build WPF applica- 
tions. This is a rare place in the .NET stack where VS 
doesn't do it all. In fact, it doesn't even come close. 
So, in this session you'll learn a number of tools you 
will be using like tools from the Expression Suite and 
some XAML design, syntax and rendering tools. 


VWPO7: WHAT'S NEW IN WPF 4.0? 

BILLY HOLLIS 

In .NET Framework 4.0, WPF gets some significant 
new capabilities. Some components and controls 
that were formerly only available as add-ons, such as 
the data grid and date picker, are now folded into the 
Framework. One of the most important is the Visual 
State Manager, and this session will compare and 
contrast the VSM to triggers. You'll also see enhance- 
ment to data binding and enhancements in XAML 
2009, including support for generics, static factory 
methods, and arguments for constructors. Finally, 
we'll take a look at enhancements in the visual 
designer in Visual Studio 2010, including picking 
styles and resources and data binding improve- 
ments. 


VVSO1: AGILE DATABASE TECHNIQUES 
USING VISUAL STUDIO ULTIMATE 2010 
RICHARD HUNDHAUSEN 

To many teams, agile database development is a con- 
tradiction in terms. Agile practices have not tradi- 
tionally applied to SQL Server development. By lever- 
aging database projects and the powerful tools 
found in Visual Studio 2010, database developers can 
participate in the same agile practices as the rest of 
the development team: Test Driven Development, 
Continuous Integration, and refactoring. In this ses- 
sion, we will set up an automated build and deploy 
environment to enable proper refactoring and test- 
ing of our database schema. 


VVSO2: BETTER SOFTWARE QUALITY WITH 
VISUAL STUDIO 2010-END TO END 
STEVEN BORG 

Learn how Application Lifecycle Management (ALM) 
coupled with Visual Studio 2010 tooling can help your 
organizations build quality into their lifecycle. The 
great features of Visual Studio 2010 will help you 
break down organizational walls between your devel- 
opers and testers, unleashing collaborative effort. In 
this presentation, you'll see a complete, demo-only, 
end-to-end demonstration of the new Testing and 
Test Case Management tools in VS 2010. You'll see a 
Test Plan being created, environments being config- 
ured, and test cases being created and run. You'll see 
bugs being discovered, filed, reproduced (from his- 
torical data!), fixed and verified. You'll see manual 
test cases being automated and included in the 
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nightly build to prevent regressions. Finally, you'll 
see how VS 2010 elevates the information to the rest 
of the team, including management. Get better soft- 
ware with Visual Studio 2010. This presentation is 
geared towards both non-technical and technical 
testers, developers, project managers, QA managers, 
and others interested in improving code quality. 


VVSO3: DEFINING AND MANAGING 
SOFTWARE REQUIREMENTS WITH VISUAL 
STUDIO 2010 

JOEL SEMENIUK 

Visual Studio 2010 provides a number of new features 
that will help your teams define and manage software 
requirements. In this session, you will get to experi- 
ence these new features hands on as well as learn 
some tips and tricks on how to decompose, visualize, 
share, and schedule requirements as well as how to 
connect software requirements to quality processes. 


VVS04: DESIGN, DON'T DECORATE 

BILLY HOLLIS 

Putting the advanced capabilities of WPF and 
Silverlight to full use requires collaboration, experi- 
mentation, and iterative prototyping. We'll show you 
all five sequential prototypes for the acclaimed 
StaffLynx application (as seen on NET Rocks TV), and 
discuss practices that worked and didn't work in real- 
world advanced Ul development. We'll also discuss 
the role of visual and interactive designers in creat- 
ing new era user interfaces, and give some tips on 
how to think about using WPF and Silverlight capa- 
bilities to make interfaces feel natural and less 
stressful to users. 


VVSO5: IMPLEMENTING SCRUM USING 
TEAM FOUNDATION SERVER 2010 
RICHARD HUNDHAUSEN 

In 2008, over 80% of agile projects used Scrum. 
Microsoft uses it internally and so do your competi- 
tors. It's time you take a serious look at this frame- 
work for managing complex projects. In this session, 
you will learn how to implement Scrum in Team 
Foundation Server 2010 using EMC's Scrum for Team 
System 3.0 process template and best practices. You 
will learn how the process template takes advantage 
of the new hierarchical work item capabilities and 
integrates with Visual Studio Test Elements. 


VVS06: VISUAL STUDIO 2010 QUALITY 
TOOLS FOR DEVELOPERS 

STEVEN BORG 

This session will demonstrate how developers use 
the Visual Studio 2010 and Team Foundation Server 
to create high quality code, reliably reproduce and 
efficiently fix reported bugs, and truly work with the 
testing team. We'll demonstrate the use of several 
important tools, such as test impact analysis, 
IntelliTrace, and other tools that help you understand 
your code, pinpoint bugs and efficiently fix them. 
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Let's face it; fixing bugs is both tedious and hard. 
Visual Studio 2010 provides the tools to both you and 
the tester to make finding, reproducing and fixing 
bugs dramatically simpler. This session is geared 
towards developers, both senior and junior, as well as 
testers and managers interested in seeing how 
developers can use Visual Studio 2010 to even more 
effectively contribute to the final quality of the 
released code. 


VVSO7: IMPROVING YOUR SOFTWARE 
DEVELOPMENT PROCESSES WITH VISUAL 
STUDIO 2010 

JOEL SEMENIUK 

At the heart of any great software development 
practice is the ability to change. In this session, you 
will learn how you can use Visual Studio 2010 to help 
improve your software development processes; from 
project management through to software testing. 
You will also learn how to modify Visual Studio 2010's 
behaviour to match ongoing change and improve- 
ment activities. 


VVSO8: LAB MANAGER-THE ULTIMATE 

“NO MORE NO REPRO” TOOL 

STEVEN BORG 

Designing, building and testing code is a hard job. 
A job made even harder by the fact that most 
organizations don't have development and test 
environments that are clean, easily reset and sim- 
ilar to the production environment. Enter virtual- 
ization... and Lab Manager. Lab Manager allows 
you to define, configure and create complete 
development or test environments as needed. It 
can coordinate both physical and virtual environ- 
ments, and comes with an incredibly powerful 
suite of effective tools that make managing envi- 
ronments simple and cost effective. Attend this 
presentation to see Lab Manager in action. We'll 
define a test environment, identify a suite of tests 
for an application, set up a new automated build, 
and let the fun begin. The automated build will 
compile the application, create a clean test envi- 
ronment, deploy the multi-tier application and run 
a complete set of automated regression tests. In 
addition, we'll show how a tester discovering a bug 
during a manual test run can, with the single click 
of a button, create a snapshot of the entire envi- 
ronment, exactly as it existed when the bug was 
found. You'll also see a developer, while reproduc- 
ing that bug, re-initialize the entire environment 
(at the moment in time the bug was discovered), 
remote into one of the boxes and track down a dif- 
ficult to reproduce bug. Lab Manager is powerful. 
Very powerful. Come see it in action. Then make 
the call; can your organization handle it? This ses- 
sion is geared towards developers, testers, archi- 
tects, IT personnel and managers who want to see 
an in-depth demo of one of the most exciting tools 
ever added to Visual Studio. 


VVSO9: MODELING AND VISUALIZATION IN 
VISUAL STUDIO 2010 

JOEL SEMENIUK 

Software modeling and visualization is extremely 
important when conveying design and specification 
information across your entire team. Visual Studio 
2010 now includes a wide range of modeling and 
visualization tools that will help you define, build, 
and test your software. In this session, you will get to 
see these features first hand and learn how these 
new integrated features will help improve your 
team's ability to produce stunning software. 


VVS10: TEAM FOUNDATION SERVER 2010- 
MIGRATE OR INTEGRATE? 

RICHARD HUNDHAUSEN 

So, Team Foundation Server 2010 is installed in your 
enterprise. That's great news. Now what? Should you 
migrate the artifacts from your existing ALM tools 
and processes, or integrate with them? It's not 
always an easy decision. While Team Foundation 
Server 2010 can comfortably replace any of your 
existing ALM tools, there may be ROI or other politi- 
cal reasons to keep them. In that case, an integration 
solution might be necessary. In this session, we will 
look at the latest technology options for migrating- 
from, or integrating-with, your existing ALM tools. So, 
if you do happen to be chained to a home-grown 
defecting tracking system, 3rd-party requirements 
management system, or an obscure, open-source 
revision tracking system, come to this session and 
find out how to put Team Foundation Server in the 
center of it all. 


VPDO1: APPLYING THE MVVM DESIGN 
PATTERN 

ROCKFORD LHOTKA 

The Model-View-ViewModel design pattern is one of 
the best ways to build a maintainable and testable UI 
in Silverlight or WPF. The MVVM pattern is emerging 
as one of the most popular ways to build XAML pres- 
entation layers, but as an emerging pattern it can be 
very confusing and difficult to find ways to gain the 
pattern’s benefits without introducing complexity or 
unnecessary code into your application. In this ses- 
sion, you will learn how to apply the pattern in ways 
that minimize code and effort, maximize productivi- 
ty, and leverage the power of both XAML and MVVM. 


VWFO1: DEVELOPING WF 4 SERVICE 
APPLICATIONS 

BRIAN NOYES 

One of the most important capabilties of Windows 
Workflow Foundation 4 is the ability to write long- 
running, stateful, persistable workflow services. You 
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can expose and consume services easily from work- 
flows in WF 4, and can have workflows talk to other 
workflows as services. This session will walk you 
through what you need to know to do exactly that. 


VWFO2: ENCAPSULATE BUSINESS LOGIC IN 
WINDOWS WORKFLOW FOUNDATION 4 
CUSTOM ACTIVITIES 

BRIAN NOYES 

To fully leverage all the power that Windows 
Workflow Foundation 4 has to offer, you need to be 
able to encapsulate bits and pieces of your business 
processes in activites in WF4. In this session, you'll 
master the activity programming model for WF 4. 
You'll learn how to create simple activities that 
invoke a chunk of business logic, how to write cus- 
tom container activities that invoke and control a set 
of child activities, and even how to write a concur- 
rent activity that runs in part of the workflow asyn- 
chronously. 


VWFO3: UNIT TESTING WORKFLOWS AND 
WCF SERVICES 

BRIAN NOYES 

In modern .NET applications, a good deal of the com- 
plex business logic of your applications lives inside 
WCF services and in workflows. However, because 
they have a fairly specialized execution environment, 
it might not be apparent how to design those work- 
flows and services for testability and how to write 
the tests. This session will show you how to do both 
of those things for some common service and work- 
flow scenarios. 


VWCO1: DISCOVER A NEW WCF WITH 
DISCOVERY IN .NET 4.0 

JUVAL LOWY 

Up until WCF 4.0, the service address had to be 
known in advance to the client. This complicated 
deployment and run time configuration. In addition, 
the service had no way of knowing that its port or 
pipe is available for use in the first place. With WCF 
4.0, you can use service address discovery to 
address both issues. The client can discover at run 
time the service address, and the service can pick up 


any available address on the fly. WCF also offers 
announcements of the service when its goes on or 
off line, and scoping the discovered services. 
Moreover, it turns out that discovery opens the door 
for new ways of composing applications and new 
design patterns of distributing information in the 
system. This session starts by discussing the basic 
support of discovery in WCF and then presents 
helper classes that streamline the interaction with 
discovery both on the client and the service side and 
the related design patterns, including a framework 
for a discovery-based publish-subscribe system. 


VSPECO1: EVENING SESSION: MUSIC AND 
PROGRAMMING~-A CURIOUS CONNECTION 
CARL FRANKLIN 

Ever wonder why so many programmers are also 
musicians? Can learning an instrument or studying 
music theory actually make you a better program- 
mer? In this session, you'll discover this connection, 
learn a little about music, and pick up a few .NET 
tools you can use to tickle both halves of your brain. 


VSPECO2: EVENING SESSION: R/C 
MADNESS 

JUVAL LOWY AND RICHARD 
CAMPBELL 

Flying a remote control airplane or helicopter, per- 
forming low or high speed aerobatics requires brain 
circuitry not unlike those of programming. Using a 
large screen and humor, Juval will teach Richard how 
to fly, and demonstrate his techniques, from hover- 
ing with airplanes to gliding with helicopters. 


VNTO1: GAME CHANGERS 

KATHLEEN DOLLARD 

NET 4.0 is more subtle than the last few versions of 
NET in exposing its most exciting features. But don't 
let this fool you-the .NET 4.0 CLR contains features 
capable of radically changing your application devel- 
opment. Two big features are the Managed 
Extensibility Framework (MEF) and the Reactive 
Framework (Rx). MEF provides open extensibility and 
allows decoupling between parts of your application 
while retaining excellent performance. One of the 
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ways MEF is useful is to build your application, or 
parts of it, as though they were a set of Lego blocks. 
The Reactive Framework supplies a push model with 
similar semantics to LINQ's pull model. One of the 
ways the Reactive Framework is useful is to create 
conceptual events from a complex series of physical 
events such as a series of mouse movements or ges- 
tures. MEF and the Reactive Framework can work 
together to create a simplified, decoupled, and high- 
ly flexible event mechanism with minimal intrusion 
of these features into your code. This session will 
teach you about MEF, the Reactive Framework, and 
how to use the two together. 


VNTO2: MAKING VISUAL STUDIO 2010 
WORK FOR YOU 

KATHLEEN DOLLARD 

Visual Studio 2010 represents the first complete 
rewrite of Visual Studio since the creation of .NET. It 
now uses WPF and MEF (Managed Extensibility 
Framework), making it easy to customize and extend. 
This session walks through creating an appropriate 
environment for your style, modifying behavior 
though new options, and finding, downloading and 
installing Visual Studio add-ins. You'll see full support 
for multi-targeting. Intellisense has more flexibility 
within code windows, and even helps out when cre- 
ating markup extensions in XAML. New windows such 
as the Call Hierarchy and Code Definition windows 
offer a more sophisticated view of your application 
code. The session will close by building a simple 
Visual Studio extension to demonstrate how you can 
further customize your environment. You'll leave 
ready to make Visual Studio 2010 effective in your 
own environment. 


VNTO3: WHAT'S NEW IN C# 4.0 AND 
VISUAL BASIC 10? 

KATHLEEN DOLLARD 

The next version of .NET will bring traditional and 
dynamic languages into closer alignment. Visual 
Basic and C# each pick up great features from the 
other. Both also get dynamic support, interop, and 
variance. In addition to language features, there are 
many new BCL features and Visual Studio features 
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that extend the way you work with your favorite lan- 
guage. This session will include the new data types- 
tuples, sorted sets, and a new integer data type. It 
will also cover code contracts which allow you to 
specify pre and post conditions for individual meth- 
ods. This directly alerts you to core issues in your 
code rather than tracking back from later symptoms. 
It also documents your intentions for method usage. 
In recognition that we use different development 
styles, Visual Studio 2010 now offers support for TDD 
development. This lets you create tests before you 
create the fulfilling code. This session introduces 
new language and supporting features with the 
major emphasis on how this set of features improves 
your development experience. 


VCFO1: INTRODUCING THE .NET SERVICE BUS 
JUVAL LOWY 

The .NET service bus is part of the new Microsoft 
Cloud Computing Windows Azure initiative, and 
arguably, it is the most accessible, ready to use, pow- 
erful, and needed piece. The service bus allows 
clients to connect to services across any machine, 
network, firewall, NAT, routers, load balancers, virtu- 
alization, IP and DNS as if they were part of the same 
local network, and doing all that without compromis- 
ing on the programming model or security. The serv- 
ice bus also supports callbacks, event publishing, 
authentication and authorization and doing all that 
in a WCF-friendly manner. This session will present 
the service bus programming model, how to config- 
ure and administer service bus solutions, working 
with the dedicated relay bindings including the avail- 
able communication modes, relying on authentica- 
tion in the cloud for local services and the various 
authentication options, and how to provide for end- 
to-end security through the relay service. You will 
also see some advanced WCF programming tech- 
niques, original helper classes, productivity-enhanc- 
ing utilities and tools, as well as discussion of design 
best practices and pitfalls. 


VCFO2: SECURING REST-BASED 

WCF SERVICES WITH THE ACCESS 

CONTROL SERVICE 

MICHELE LEROUX BUSTAMANTE 

The Access Control Service (ACS), part of Windows 
Azure platform AppFabric, makes it easy to secure 
REST-based services using a simple set of standard 
protocols. In addition to enabling secure calls to 
REST-based services from any client, the ACS unique- 
ly makes it possible to secure calls from client-side 
script, and enables federation scenarios with REST- 
based services. This session will provide a tour of 
ACS features and demonstrate scenarios where the 
ACS can be employed to secure REST-based WCF 
services and other web resources. You'll learn how to 
configure ACS, learn how to request a token from the 
ACS, and learn how applications and services can 
authorize access based on the ACS token. 
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VCFO3: WCF WORKFLOW SERVICES AND 
WINDOWS SERVER APPFABRIC: A NEW 
APPROACH TO WCF SERVICE DESIGN 
MICHELE LEROUX BUSTAMANTE 

The .NET Framework 4 includes interesting new fea- 
tures across almost every platform stack including 
for WCF and Workflow-bringing with it an improved 
approach to WCF Workflow Services. Certainly a bet- 
ter performing workflow runtime, improvements to 
the workflow designer, new activities supporting 
receiving and sending messages, and new tech- 
niques for integrating workflow and WCF all make 
designing workflow services a better experience. But 
regardless if you need a complex business process 
expressed in workflow, there are other compelling 
reasons to look at building workflow services going 
forward-and at the top of the list is visibility into the 
success or failure of service calls in development 
and production-thanks to Windows Server AppFabric. 
This session will review the new experience WCF 
developers will face building services as WCF 
Workflow Services, discuss and illustrate the benefits 
of this approach, and highlight limitations including 
choice of WCF binding and security models for 
incoming and outgoing calls to services. You'll also 
get a tour of AppFabric features that may inspire you 
to design WCF Workflow Services to simplify trou- 
bleshooting and monitoring your applications. 


VDEO1: SERVICE-ORIENTED 

DEVELOPMENT PROCESS 

JUVAL LOWY 

When you develop a service-oriented application, it 
would be naive of you to expect that the only things 
you will do differently will be limited to design and 
technology. The development process itself needs to 
be service-oriented. You cannot “stare into the fire” 
of WCF without a mature service-oriented develop- 
ment process supporting your effort. This session 
presents you with a service-oriented development 
process that you can apply to your WCF-based prod- 
ucts to achieve robust applications, manage require- 
ments and ensure faster time to market. 


OVERVIEW OF MICROSOFT 

DATA ACCESS GUIDANCE 

MICROSOFT 

Microsoft provides a number of data access tech- 
nologies for use in building applications. This session 
walks through many of the questions customers 
need to answer in order to help drive their data 
access technology choices for their applications. It 
also includes a discussion around DAL technologies 
appropriate for application types (MVC, Webforms, 
Silverlight, etc.), methodologies (DDD, Model First, 
Code Oriented), database state & change allowed, 
and more. 


DATA SERVICES, RIA SERVICES, WCF 
SERVICE MODEL, SELF TRACKING 
ENTITIES......WONDERING HOW TO CHOOSE 
THE RIGHT NTIER TECHNOLOGY TO 
ACCOMPLISH YOUR TASK? 

MICROSOFT 

Come to this interactive session and learn about the 
Microsoft technologies that are currently available 
to aid in the development of NTier systems. This ses- 
sion walks through many of the questions customers 
need to answer in order to help drive their technolo- 
gy choices while building NTier applications, includ- 
ing how to pick the technology for your project and 
what the Microsoft technology Roadmap for this 
space looks like. 


OVERVIEW OF THE ENTITY FRAMEWORK 4 
MICROSOFT 

Come see how the ADO.NET Entity Framework 
enables new capabilities to leverage multiple devel- 
opment approaches, for example the use of code- 
first, model-first, and database-first. Hear how, 
regardless of the development approach, developers 
will benefit from the Entity Framework and the deep 
integration with the rest of the Microsoft .NET 
Framework 4, such as the Microsoft ASP.NET MVC, 
Dynamic Data, and Windows Presentation 
Foundation. 


OVERVIEW OF WCF (FORMERLY ADO.NET) 
DATA SERVICES 4 

MICROSOFT 

WCF Data Services (formerly known as ADO.NET Data 
Services) 4.0 provides developers with a number of 
new and highly anticipated features. This demo-cen- 
tric session will walk through the use of these new 
features such as Web Friendly Feeds, improved Data 
Binding, Server Driven Paging, Count and Enhanced 
Blob support. 


UNDERSTANDING EFFICIENT USER 
INTERFACE DESIGN 

MARKUS EGGER 

Check Web site for abstract. 


A USER INTERFACE GRAPHICS DESIGN 
LESSON FOR DEVELOPERS 

MARKUS EGGER 

Check Web site for abstract. 
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BUILDING AN ASP.NET 4 WEB FORMS 
APPLICATION 

MICROSOFT 

ASPNET 4 includes a lot of investment in improve- 
ments intended to make developing your Web Forms 
applications a better and smoother experience. 
Major investments were made in producing semantic 
markup that’s easily stylable, improvements to 
Dynamic Data and data source controls, etc. Come 
learn how to leverage these new improvements as 
we engage in a true app building exercise and build 
an application start to finish. 


BUILDING A WEB APP WITH ASP.NET MVC 2 
MICROSOFT 

ASP.NET MVC 2 builds on top of the success of 
ASP.NET MVC 1.0 by adding Templated helpers, Areas, 
client validation, and data annotations support. In 
this session, we'll show these new features as we 
build a soup-to-nuts ASP.NET MVC application using 
Visual Studio 2010. 


BUILDING RIAS WITH THE ASP.NET AJAX 
LIBRARY AND JQUERY 

MICROSOFT 

JavaScript hasn't had the greatest reputation over 
the years, but times are changing, and real-world 
client-side application development is becoming 
easier and more fun. Come see how ASP.NET AJAX 
Library and jQuery work together to provide a first- 
class options for RIA development. You'll learn how 
Visual Studio 2010 provides a great editing experi- 
ence for working with JavaScript. You'll learn to love 
JavaScript, and so will your customers. 


BUILDING STANDARDS-COMPLIANT WEB 
APPS IN ASP.NET 4 AND VS 2010 
MICROSOFT 

Come learn how to build standards-compliant Web 
applications using ASP.NET 4.0 and Visual Studio 
2010. Putting it all together, controling markup from 
ASP.NET WebForms to simplifiy integrating designer 
produced CSS files. This session covers using JQuery 
to add rich interactivity to WebForms and adding 
Intellisense for HTML 5. 


ACS301: USING JQUERY WITH ASP.NET 
RICK STRAHL 

In this session, you'll learn how to take advantage 
of jQuery in your ASP.NET applications. Starting 
with an overview of jQuery client features via many 
short and fun examples, you'll find out about core 
features like the power of selectors to select doc- 
ument elements, manipulate these elements with 
jQuery's wrapped set methods in a browser inde- 
pendent way, how to hook up and handle events 
easily and generally apply concepts of unobtrusive 
JavaScript principles to client scripting. The ses- 
sion also covers AJAX interaction between jQuery 
and the .NET server-side code using several differ- 
ent approaches including sending HTML and JSON 
data. The session also covers how to avoid user 
interface duplication by using client-side templat- 
ing. This session relies heavily on live examples 
and walk-through. 


ACS302: JQUERY EXTENSIBILITY AND 
INTEGRATION WITH ASP.NET SERVER 
CONTROLS 

RICK STRAHL 

One of the great strengths of the jQuery 
Javascript framework is its simple, yet powerful 
extensibility model that has resulted in an explo- 
sion of plug-ins available for jQuery. You need it- 
chances are there's a plug-in for it! In this session, 
we'll look at a few plug-ins to demonstrate the 
power of the jQuery plug-in model before diving in 
and creating our own custom jQuery plug-ins. We'll 
look at how to create a plug-in from scratch as 
well as discussing when it makes sense to do so. 
Once you have a plug-in it can also be useful to 
integrate it more seamlessly with ASP.NET by cre- 
ating server controls that coordinate both server- 
side and jQuery client-side behavior. I'll demon- 
strate a host of custom components that utilize a 
combination of client-side jQuery functionality 
and server-side ASP.NET server controls that pro- 
vide smooth integration in the user interface 
development process. This topic focuses on com- 
ponent development both for pure client-side 
plug-ins and mixed-mode controls. 


ACS303: BUILD CLIENT-SIDE USER 
INTERFACES WITH ASP.NET 4.0 AJAX CLIENT 
SIDE TEMPLATING AND CONTROLS 

RICK STRAHL 

Template layout and controls have been popular 
with developers for creating server-side user 
interfaces with ASP.NET for years, but sophisticat- 
ed client-side templating has been amiss from 
Microsoft's AJAX tools until ASP.NET 4.0. The new 
client templates introduced with ASP.NET AJAX 4.0 
provide a powerful mechanism for declaratively 
laying out HTML and binding data into this layout 
using pure client code. Client templates are an 
effective way to build pure AJAX applications 
where most or all of the UI is rendered using AJAX. 


In this session, you'll learn why templates are so 
powerful in client-side scripting and see specific 
examples of how to create templates and bind 
them with data from various server-side data 
sources. We also look at some related client tech- 
nologies like live bindings and Observable objects 
that simplify working with data on the client side. 


ACS304: BUILDING MASTER/DETAIL VIEWS 
IN ASP.NET AJAX 4 

DINO ESPOSITO 

Master/detail views are ideal to render one-to- 
many relationships, and such relationships are so 
common in the real world that a Web platform that 
doesn't provide an ad hoc and effective set of tools 
for that is kind of lame. ASP.NET Web Forms pro- 
vides a great support for master/detail scenarios 
but it can be made AJAX-compliant via partial ren- 
dering. In this session, instead, we discover how to 
leverage new data binding tools in ASP.NET AJAX 4 
and jQuery to build effective master/detail views 
that minimize payloads via AJAX requests and 
number of roundtrips via local caching. 


ACS305: CLIENT-SIDE DEVELOPMENT USING 
THE NEW FEATURES OF AJAX 4 

RACHEL APPEL 

This session will show just how easy ASP.NET AJAX 
development has become for every Web developer, 
from using the new rich UI features & controls and 
also when working with the ‘pure’ AJAX scripting 
model. This session explores how ASP.NET AJAX is 
used today as well as the new ASP.NET AJAX client 
template and data binding framework, declarative 
Ul, new controls, client data binding, and using 
AJAX with ADO.NET Data Services. 


ASL301: FIXING RIA BUGS: USABILITY, 
SECURITY, SEO 

CHRISTIAN WENZ 

We all love Rich Internet Applications, no matter 
which technology was used (for instance AJAX, or 
Silverlight). However, we also hate many of those 
Rich Internet Applications: their usability suffers 
from breaking with web fundamentals like browser 
navigation buttons, they often have security vul- 
nerabilities which are easy to exploit, and they are 
very hard to be found in search engines. This ses- 
sion will tackle typical issues, introduce counter- 
measures, and discuss how much effort these 
extra steps actually require. Demos will focus on 
ASP.NET AJAX and Silverlight, but the content is 
technology-agnostic most of the time. 
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ASL302: UNDERSTANDING SILVERLIGHT 
SECURITY 

CHRISTIAN WENZ 

As with most browser plugins, Silverlight applica- 
tions run under strict security rules. These rules 
limit the ability to send and receive data to and 
from servers, to interact with JavaScript code, to 
access built-in NET functionality and to access the 
local machine the Silverlight application runs on. 
This session runs through both these limitations 
and built-in hooks to overcome some of these 
restrictions. We will also provide best practices on 
which security settings to use in cases where 
Silverlight allows us to do so. 


ASL303: USING RIA SERVICES IN 
SILVERLIGHT APPLICATIONS 

DAN WAHLIN 

Silverlight and AJAX technologies provide a nice 
set of features that can be used to build Rich 
Internet Applications (RIAs) but with the number of 
data access techniques available it can be difficult 
to know which one to choose. In this session, Dan 
Wahlin will discuss Microsoft's RIA Services frame- 
work and demonstrate how it can be used to sim- 
plify n-tier architectures and provide a consistent 
way to access, validate and modify data in 
Silverlight applications. 


ASL304: GET STARTED BUILDING 
SILVERLIGHT APPLICATIONS 

DAN WAHLIN 

Interested in learning more about Silverlight but 
don't know where to start? In this session, 
Silverlight MVP Dan Wahlin will show you how to 
create Silverlight applications from scratch using a 
learn-by-example approach. Topics covered 
include XAML, controls, styles and templates as 
well as data binding. Different techniques for 
accessing data from within a Silverlight application 
will also be discussed as well as some of the new 
Silverlight features that allow applications to run 
out of the browser. 


ASL305: SILVERLIGHT DATA INTEGRATION 
OPTIONS AND USAGE SCENARIOS 

DAN WAHLIN 

Silverlight provides several different options for 
integrating distributed data into applications. In 
this session, Silverlight MVP Dan Wahlin will dis- 
cuss different network options available in 
Silverlight 3 and 4 and explain when and where 
they should be used. Topics covered include under- 
standing cross-domain policy files (and why you 
should care about them), integrating with ASMX 
and WCF services, making REST calls, leveraging 
XML and JSON serialization techniques, using LINQ 
to XML plus using sockets. 
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ASL306: BUILDING ARCHITECTURALLY 
SOUND SILVERLIGHT APPLICATIONS 

DAN WAHLIN 

There are many different architectural patterns 
that can be used when building applications but 
choosing the proper pattern can be challenging. 
While there's no “one size fits all" answer to the 
question for Silverlight applications, there are rec- 
ommended best practices that can be followed. In 
this session, Silverlight MVP Dan Wahlin will discuss 
the Model-View ViewModel (MVVM) pattern and 
demonstrate how Silverlight applications can take 
advantage of it. Topics covered include available 
MVVM frameworks for Silverlight, building your 
Model layer and WCF service operations, building a 
service agent layer, creating ViewModel classes, 
using an event bus, and binding ViewModel objects 
to your Silverlight controls. Several tips and tricks 
learned while building enterprise-level Silverlight 
applications will be discussed during the session. 


ASL307: WILL IT BLEND? 

SHAWN WILDERMUTH 

It's easy to assume that the Expression toolset is 
just for designers. It's even got that cool dark back- 
ground with a completely non-Windows looking 
skin. But is that the reality? In this session, | will 
show developers how Blend can be used to make 
their jobs quite a bit easier, even without a single 
ounce of artistic talent. 


ASL308: NINJA DATA BINDING 

SHAWN WILDERMUTH 

It may be simple to use data binding in Silverlight, 
but there are a plethora of tips and tricks to make 
you a deadly assassin of not only displaying but 
also retrieving data from your users. 


APF201: SEARCH ENGINE OPTIMIZATION 101 
CHRISTIAN WENZ 

Some spam mails still promise to get you a spot in 
the first ten results of a search engine-at least if 
the company behind it has less than eleven cus- 
tomers. This session will debunk some search 
engine myths and give you relevant information on 
how you can increase your chances of being found 
in search engines. We will discuss how search 
engines find, index and rank websites, identify typ- 
ical mistakes and best practices, and have a spe- 
cial look at AJAX and Silverlight Rich Internet 
Applications where some extra effort is needed to 
make search engines (and yourself) happy. 


APF302: TESTING AND PERFORMANCE 
TUNING ASP.NET WITH VISUAL STUDIO 2010 
TEST EDITION 

RICHARD CAMPBELL 

The latest version of Visual Studio takes web test- 
ing to a new level-you can better analyze and 
instrument your ASP.NET applications to under- 
stand where they are fast, where they are slow and 
where they are broken. In this session, you'll see 
Richard take a simple application with serious per- 
formance limitations and use Visual Studio to help 
diagnose the performance problems and find solu- 
tions to them. Along the way there's sure to be 
some bugs introduced that will also have to be 
diagnosed and repaired. This session digs into the 
benefits of various forms of caching, understand- 
ing the consequence of performance tuning and 
how to build really real load tests that can let you 
deploy your ASP.NET applications with confidence. 


AWS301: EXPLORING DESIGN STRATEGIES 
FOR RIAS AND WCF 

MICHELE LEROUX BUSTAMANTE 

Rich Internet Application (RIA) technologies make 
it possible to present data to users in an interest- 
ing and interactive manner. Common approaches 
for building RIAs are to use ASP.NET Web Forms and 
a long list of AJAX controls, to build MVC-based 
applications and related AJAX features, and to use 
Silverlight and XAML. Applications built with the 
.NET Framework 3.0 and beyond typically rely on 
WCF to expose data and business functionality. 
Recent innovations make it very easy to interact 
with data exposed by REST-based WCF services and 
ADO.NET Data Services. This yields questions about 
the best design approach for WCF services, to 
incorporate a model that will also support other 
system requirements including the presence of a 
DMZ, a unified security model across services, the 
question of SOAP or REST-based service design, 
and the question of when ADO.NET Data Services 
are appropriate. This session will explore how to 
consume WCF services from the various RIA clients 
showing the client code required to achieve this, 
demonstrating new features that streamline the 
process, and discussing possibilities and limita- 
tions of various architectural models to support 
RIAs including security implications. 
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ADA301: BUILDING DATA-CENTRIC WEB 
APPLICATIONS USING ASP.NET 4 

DYNAMIC DATA 

RACHEL APPEL 

If you are tired of the same old ASP.NET Web Forms, 
GridViews, and ADO.NET data access code that 
make up your current applications, then you'll 
want to take a closer look at ASP.NET Dynamic 
Data. ASP.NET Dynamic Data is Microsoft's new 
technology that provides a template infrastructure 
for your application, page and fields based on your 
application's data model. In this session, you will 
learn concepts and learn to use application tem- 
plates to create an ASP.NET dynamic data web 
application. We'll then create customizations at the 
application and page levels showing how easy 
website maintenance is when using ASP.NET 
Dynamic Data. We'll also cover field-level cus- 
tomizations by supplying data display formats, 
custom field types, and data validation based on 
the application's data model, created using the 
Entity Framework. 


ADA302: A STRATEGIC COMPARISON OF 
DATA ACCESS TECHNOLOGIES 

MICHELE LEROUX BUSTAMANTE 
Thanks to recent innovations from Microsoft 
including LINQ, the Entity Framework and ADO.NET 
Data Services, choosing a technology for data 
access architecture has become a subject for 
debate. Among other things, developers must bal- 
ance productivity, elegance and performance. 
Some common questions include: Are data readers 
and data sets still useful? How should | choose 
between LINQ and Entity Framework models? 
Should | design custom entities or use types that 
follow the database schema? Should | use ADO.NET 
Data Services to expose my data model or control 
access via WCF business services? This session will 
look at data access architecture for each of these 
technologies, illustrate common practices when 
employing each, discuss pros and cons, and help 
you better understand how to choose the right 
technology for your scenario. 


AMV301: INSIDE ASP.NET MVC 

HTML HELPERS 

DINO ESPOSITO 

One of the best-selling points of the ASP.NET MVC 
framework is that it enables developers to gain 
total control over the generation of the HTML 
markup. However, while Web developers loudly 
demanded more control over HTML, they may not 
be so happy to handcraft any single HTML element. 
As the name suggests, HTML helpers just help you 
to build common blocks of HTML more quickly. In 
the session, we'll review new helpers introduced 
with ASP.NET MVC 2 (in particular, templates) and 
discover how to build custom helpers. 


AMV302: M IS FOR MODEL 

SCOTT ALLEN 

This session is an in-depth look at building models 
in ASP.NET MVC applications. We'll talk about the 
best practices and trade-offs to evaluate when 
deciding on model objects. We'll look at using pop- 
ular persistence frameworks and discuss the pros 
and cons of entities versus data transfer objects as 
models. By the end of this session, you should have 
all the information you need to build effective 
models for an ASP.NET MVC application. 


AMV303: V IS FOR VIEW 

SCOTT ALLEN 

Attend this session to get an in-depth look at build- 
ing views for ASP.NET MVC applications. We'll look at 
master pages, partial views, and the role of HTML 
helpers. We'll examine and evaluate alternative view 
engines and demonstrate the best practices for 
building maintainable views for MVC applications. By 
the end of this session you'll be ready to implement 
effective views for your own MVC applications. 


AMV304: ASP.NET MVC FOR DUMMIES 
PAUL LITWIN 

Are you comfortable creating ASP.NET Web Form 
applications but even a little curious about what 
all the fuss is about MVC and test-driven develop- 
ment? In this session, Web Form junkie Paul Litwin 
will take a critical look at the world of ASP.NET MVC, 
but not from any expert point of view. Instead, Paul 
will share his experience as a Web Form developer 
who decided to take a closer look at this radical 
new approach to ASP.NET development. Come hear 
what Paul learned and whether he thinks there's 
anything good to come out of ASP.NET MVC. 


AMV305: APPLYING SOLID PRINCIPLES TO 
YOUR ASP.NET MVC 2 APPLICATION 
STEVEN SMITH 

Do your larger applications suffer from code rot to 
the point where there are parts of the application 
that everyone is afraid to touch? Would you char- 
acterize your app's architecture as “elegant” or is 
it a “big ball of mud?” In this session, learn how to 
apply various OOP best practices such as Robert 
Martin's SOLID principles to keep code simple and 
maintainable. The session introduces a simple 
ASP.NET MVC application which doesn't follow best 
practices and gradually refactors it as each princi- 
ple is introduced, resulting in much cleaner, more 
maintainable code. No prior experience with 
ASP.NET MVC is expected, and most of the princi- 
ples discussed apply equally well to non-MVC or 
even non-web applications as well. 


AMV306: WHAT'S NEW IN ASP.NET MVC 2? 
STEVEN SMITH 

In this session, Steve will quickly highlight the new 
features available in ASP.NET MVC 2. ASP.NET MVC 
offers a new way to develop ASP.NET applications 
that allows for finer control of the application's 
behavior and greater separation of concerns with- 
in the architecture. ASP.NET MVC 2 builds on this 
platform by adding several new features, such as 
Areas, which can be used to break apart a large 
site into several deployable subsections. Another 
much-anticipated new feature centers on valida- 
tion, and the new version includes support for 
model validation providers which can be used as- 
is or swapped out with a custom implementation, 
and client-side validation support using jQuery. 
The new release also includes templated helpers 
and strongly typed UI helpers, which can make it 
much quicker to create views for displaying and 
capturing data. 


ARP301: CREATING CHARTS WITH THE 
MICROSOFT CHART CONTROL 

PAUL LITWIN 

Microsoft released a free charting control with 
"NET 3.5 SP1. This chart control, which can be used 
from both ASP.NET and Windows Forms applica- 
tions has a number of advanced capabilities for 
producing flexible and informative charts. The 
control is based on the same charting package 
that's part of SQL Server 2008 Reporting Services, 
but unlike the Reporting Services charts, this con- 
trol can be programmatically manipulated at run- 
time. In this session, you will learn how to get 
started with the Microsoft Chart Control to create 
visually compelling charts from within your 
ASP.NET applications. 


AWF301: RENDERING SEMANTIC MARKUP 
WITH WEB FORMS 4 

RACHEL APPEL 

ASP.NET Web Forms has long been the principal 
way to create ASP.NET applications. However, it's 
not without some obstacles, particularly in the 
areas of rendering finely tuned and highly con- 
trolled markup. By using the features of ASP.NET 4 
you can easily determine and guide the output cre- 
ated by ASP.NET server controls as you see fit. In 
this session, Rachel will walk you through creating 
and controlling the HTML markup that you, the 
developer, really want to render. You'll see how to 
control ViewState, ClientIDs (for use with 
JavaScript, jQuery or AJAX), and page metadata. 
The session will then focus on web forms routing 
and crafting SEO friendly URLs so you can achieve 
the perfect output for your application. 
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AWF302: IMPROVING TESTABILITY IN 
ASP.NET WEB FORMS WITH MVP 

DINO ESPOSITO 

ASP.NET Web Forms is not exactly an environment 
that makes it easy to automate testing. Most of the 
time, you need to resort to ad hoc tools specifical- 
ly architected to speed up testing of ASP.NET Web 
Forms pages while making it cost effective. With a 
bit of refactoring, however, you can redesign the 
structure of individual pages to match the guide- 
lines of the Model-View-Presenter pattern. This 
gives you an immediate benefit in terms of 
increased capabilities to test the code behind your 
pages through popular testing tools. At the same 
time, it improves the design of pages adding more 
separation of concerns. Being view-focused, the 
MVP pattern is not necessarily a pattern that 
applies to the application as a whole but can be 
instead applied piecemeal to a few related pages 
at a time. In this session, you'll see an end-to-end 
MVP solution that improves the design of a sample 
Web Forms page. 


AWF303: WHAT'S NEW FOR WEB FORMS IN 
VISUAL STUDIO 2010? 

PAUL LITWIN 

MVC, Silverlight, and AJAX have been getting most 
of the attention of late in the ASP.NET world, but 
what about ASP.NET Web Forms. Is it still moving 
forward? You bet! In this session, you will learn 
about the enhancements to ASP.NET that will be 
useful to the Web Form developer. These include a 
cleaner web.config file, control over Clientld val- 
ues, SEO enhancements, improved snippet support, 
URL routing for Web Forms, view state improve- 
ments, CSS improvements, several control updates, 
and a new shortcut for embedding HTML encoded 
expressions in HTML. 


AWF304: PRAGMATIC ASP.NET TIPS, 
TRICKS, AND TOOLS 

STEVEN SMITH 

Every experienced ASP.NET developer has picked 
up a few cool tricks or useful tools that they put to 
use on every new project after they've learned 
them. This session draws upon the experience of 
many successful ASP.NET developers and distills 
this knowledge into a collection of tips and tricks 
you can start using in your work today. Some of the 
topics covered in this session include error han- 
dling, tracing, caching, base page classes, site lay- 
out and architecture, and data access best prac- 
tices. You'll learn about highly reusable Http 
Modules and Handlers and a few code routines you 
may want to add to your personal library. 


ASL309: BUILDING BEHAVIORS FOR 
SILVERLIGHT 4 

SHAWN WILDERMUTH 

The ability to attach verbs to objects in Silverlight 
4 represents a powerful extension to the data 
bound model. In this session, Shawn will build a 
Behavior using managed code then and show how 
it works in Blend 3 and XAML. 


ASL310: VALIDATING DATA IN SILVERLIGHT 
SHAWN WILDERMUTH 

Validating data in data bound forms is a require- 
ment for almost every application. In Silverlight 4, 
this is exacerbated by the fact that the data 
objects are usually a network request away. In this 
session, Shawn will show you how to use and share 
the validation attributes and validators to verify 
your own code in the browser. 


ASP.NET FUTURES 

MICROSOFT 

ASP.NET has evolved a lot in the last few years with 
the addition of ASP.NET MVC and Dynamic Data, as 
well as the continuous improvement of WebForms 


JOIN US AT OUR NETWORKING LUNCHEON 


KATHLEEN DOLLARD 


RACHEL APPEL 


KIMBERLY L. TRIPP 


MICHELE LEROUX BUSTAMANTE 


and ASP.NET AJAX. With ASP.NET 4 and ASP.NET MVC 
2 now released, what's next? This session will pro- 
vide a roadmap and include demos of future direc- 
tions the team is exploring, including investments 
in simplicity for building Web applications. 


DEPLOYMENT IN THE ENTERPRISE 
MICROSOFT 

+ Team Build + Team Test 

+ Staging databases + Workflow customization 
+ TSDATA + Parameterization 

+ Web.config transformation 


AWP301: BUILDING AN END-TO-END 
SOLUTION THAT REACHES 3 SCREENS 

USING THE MICROSOFT STACK 

LAURENCE MORONEY 

In this two-part session, Laurence will cover build- 
ing a full solution, showing how the value of using 
.NET on the Microsoft Web Platform allows you to 
touch every tier in a multi-tier architecture. You'll 
see how to build a full solution (a lightweight appli- 
cation for managing your children’s school 
grades), from soup to nuts using the same, consis- 
tent, technology stack. 

You'll see how to architect the solution from the 
database, through the data retrieval and aggrega- 
tion, through business logic, through a web front 
end. Then you'll see the value of different client 
types, and how each type can be built on the NET 
stack. First is the “Lightweight Web” where, using 
ASP.NET MVC you'll learn to build a standards-com- 
pliant, rich interface that runs in the browse. 
Second, for a richer experience, you'll see how 
Silverlight can be delivered from this architecture. 
Third, for the best possible experience, you'll look 
at how the Windows 7 desktop can be leveraged for 
a super rich UI that includes integration with pop- 
ular application suites such as MS Office. 
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INTRODUCING MASTER DATA SERVICES IN 
SQL SERVER 2008 R2 
MICROSOFT 


Master Data Services is a component of SQL Server 
2008 R2 that will enable you to improve the quali- 
ty of key data assets such as products, customers, 
locations, accounts, cost centers and many others. 
Come learn how MDS can serve a wide range of 
analytic (dimension management) and operational 
(master data management) scenarios. This session 
will cover product architecture and include an 
extensive demonstration. 


LARGE SCALE DATA WAREHOUSES WITH 
MICROSOFT SQL SERVER 2008 R2 PARALLEL 
DATA WAREHOUSE 

MICROSOFT 


This session provides an overview of the new Data 
Warehousing capabilities in SQL Server 2008 R2 
Parallel Data Warehouse Edition. This new edition 
implements a Massively Parallel Processing (MPP) 
architecture on top of the robust scale-up capabili- 
ties of SQL Server to enable massive scale-out, into 
the tens and hundreds of terabytes, for the same 
low TCO that SQL Server delivers. In collaboration 
with several hardware partners, SQL Server Parallel 
Data Warehouse will provide an appliance-like solu- 
tion that lets customers customize the system to 
conform to their existing hardware environment. 


SQL SERVER CONSOLIDATION 
PRESCRIPTIVE GUIDANCE 
MICROSOFT 


This session will focus on helping to choose 
between using virtualization, instance, or database 
as a SQL Server consolidation strategy. We will 
highlight the key areas to consider, features that 
are available (in SQL Server 2008 and R2) for each 
approach as well as provide some of the important 
differentiators for helping to make a decision. We 
will provide decision trees to help guide adminis- 
trators through the process and also provide case 
studies and customer scenarios. 


BUILDING AND MANAGING APPLICATIONS 
WITH SQL AZURE AND WINDOWS AZURE 
MICROSOFT 


Are you looking to reduce the costs of building and 
maintaining enterprise applications? Do you want 
to extend the reach of your applications across 
multiple devices, locations, and partners? SQL 
Azure and Windows Azure provide you a friction 
free, highly scalable platform for building applica- 
tions. The scale and reach of the cloud lights up a 
new class of application scenarios. Come see how 
easy it is to consume SQL Azure from within 
Windows Azure. 


ADVANCED MICROSOFT SQL SERVER 2008 
R2 STREAMINSIGHT 
MICROSOFT 


Microsoft SQL Server 2008 R2 Streaminsight is a 
new platform for building rich data processing 
over real-time event streams. Come to this session 
to get a detailed walkthrough of the three major 
components of Streamlnsight: input and output 
adapter SDK, the Streamlnsight engine runtime, 
and the semantics of the continuous standing 
queries hosted in the Streamlnsight engine. 
Examine best practices for performance and scala- 
bility, and hear a few case studies of real-world 
Streamlnsight implementations and the lessons 
learned from them. 


DEVELOPING WITH SQL SERVER SPATIAL: 
FLAT MAPS TO ROUND EARTH 
MICROSOFT 


With the advent of GPS devices, spatial data is 
becoming increasingly more central to data pro- 
cessing and everyday applications. This session 
provides an overview for the Microsoft SQL Server 
2008 spatial types and methods, focusing on some 
common pitfalls and differences between the flat 
map type geometry and round earth type geogra- 
phy. This session is geared towards programmers 
with some spatial background, but is applicable for 
the spatially novice audience as well. 


DATA TIER APPLICATIONS IN 
VISUAL STUDIO 2010 
MICROSOFT 


Come explore the new enhancements in SQL 
Server 2008 R2, known as Application and Multi- 
Server Management, which enable a more effi- 
cient way to develop, deploy, and manage data- 
tier applications and instances. See how a new 
single unit of deployment for database applica- 
tions is integrated with Microsoft Visual Studio 
and helps enable developers to more quickly write 
higher quality database applications, author 
deployment policies based on the needs of their 
applications, and hand off a single package to 
database administrators. Also, learn how improve- 
ments combine a first-class Transact-SQL IDE with 
a new Visual Studio 2010 project template known 
as .DACPAC (Database Application Component) to 
produce a comprehensive model of the objects, 
policies, and runtime resources required by a 
data-tier application. 


PUTTING IT ALL TOGETHER-BUILDING 
APPLICATIONS THAT SCALE FROM ON- 
PREMISES TO THE CLOUD 
MICROSOFT 


SQL Server, uniquely, has an architecture that 
scales from mobile devices, to enterprise class 
RDBMS, to the largest data warehouses, to flexible 
cloud solutions. This presents some challenges, 
but for the savvy developer, some great opportu- 
nities, especially when you consider that SQL 
Server has a unified development and manage- 
ment environment across these platforms. In this 
session, we'll look at how you can build applica- 
tions that work on all platforms, and how you can 
quickly and easily change your deployment model 
to suit your changing business requirements. 
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HIGH AVAILABILITY AND DISASTER 
RECOVERY FOR MISSION CRITICAL 
APPLICATIONS - BEST PRACTICES 
AND RECOMMENDATIONS 
MICROSOFT 


Mission critical applications require careful plan- 
ning to achieve maximum uptime. Various factors 
like availability SLAs for RPO (Recovery Point 
Objective) and RTO (Recovery Time Objective), log 
generation rates, latency, storage environment, 
virtualization, etc., contribute towards building the 
availability strategy. Come to this session to learn 
about how you can develop the right HADR solution 
for your environment. We will share the best prac- 
tices and real life customer deployment experi- 
ences to reinforce key points. Technologies that we 
will cover include Failover Clustering, Database 
Mirroring, Log Shipping, Transactional Replication 
& Hyper-V. 


PLANNING A COMPLETE BI 
INFRASTRUCTURE FOR YOUR BUSINESS 
MICROSOFT 


Business Intelligence can cover a wide range of 
topics, from data integration and data quality, 
through enterprise analytics, to dashboards and 
end-user tools. This session aims to help the IT pro- 
fessional charged with “bringing Bl to the busi- 


ness.” We'll survey the business and technical 
issues to be addressed, and we'll equip you with a 
simple, but effective methodology for approaching 
BI problems. You'll return to your data center with 
a much better understanding of Bls benefits, but 
also a surer grasp of where and how to start imple- 
menting a solution effectively. 


DEVELOPING RICH REPORTING SOLUTIONS 
WITH MICROSOFT SQL SERVER 2008 R2 
MICROSOFT 


Did you always want to be the hero and build pro- 
fessional looking reports in a few clicks? Do you 
need to empower your users to build their own 
reports? Do you need to light up your applications 
with interactive reports? This session will walk you 
through the latest improvements of SSRS 2008 R2 
by showing you how to build reports with Maps, 
Data bars, Sparklines, and indicators with a few 
mouse clicks by simply using the new Report part 
gallery. This session will also demo the new report 
manager, report viewer and new integration with 
SharePoint 2010. 


MANAGING POWERPIVOT FOR IT 
(PREVIOUSLY PROJECT GEMINI) 
MICROSOFT 


Abstract: This session focuses on the role of IT Pros 
in the Managed Self-Service BI environment con- 
sisting of PowerPivot for Excel and SharePoint. We 
will show how to setup a new SharePoint farm with 
PowerPivot from scratch, and also show how you 
can add PowerPivot into your existing SharePoint 
installation. We will also demonstrate the tools and 
services available to IT Pros for managing the 
PowerPivot environment, including the 
Management Dashboard. 


Upcoming articles include: 


ShareP 


Hone your skills with SharePoint tips and tricks, product reviews, and 
solutions you'll find in the all new SharePointPro Connections magazine. 
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SDB401: COLLECTING AND ANALYZING FILE 
AND WAIT STATISTICS 
ANDREW KELLY 


Since SQL Server 2000 we have had the ability to 
collect statistics on two key areas in terms of per- 
formance directly from within SQL Server. More 
specifically these are the File & Wait statistics and 
the information that can be gleaned from these 
has increased dramatically with each new release. 
SQL Server 2008 currently has over 480 events so 
far. This session will show you how to efficiently 
capture and analyze the information provided by a 
set of DMVs in SQL Server 2005 and SQL Server 
2008. This knowledge will dramatically decrease 
the amount of time spent looking for bottlenecks 
in your system. 


SDB302: SAY NO TO MAINTENANCE PLANS 
ANDREW KELLY 


The built-in Maintenance Plans are OK to get up and 
running in a hurry but they are far from ideal. There 
are inherent limitations with the implementation 
and in the event there is a problem, troubleshoot- 
ing can be almost impossible. This session will 
cover in detail a set of stored procedures that you 
can use to create your own custom maintenance 
jobs. You will have the flexibility to modify them to 
suit your every need far easier than the 
Maintenance Plans ever could. And since these uti- 
lize pure T-SQL they are easy to maintain and far 
easier to troubleshoot than the “black boxed” built- 
in maintenance plans. Creating your own custom 
jobs is fast and as a result you will have a much bet- 
ter understanding of what is being done by each 
task putting you in a better position to effectively 
troubleshoot any problems that may arise. 


SDB303: AUTOMATING AND ANALYZING 
WITH SQL TRACE AND RML UTILITIES 
ANDREW KELLY 


SQL Profiler is a terrific tool that many of us use on 
a regular basis. But there are some inherent limi- 
tations and potential performance implications 
that everyone should be well aware of. Analyzing 
data directly thru Profiler can be difficult as well 
when dealing with large amounts of data and 
events. The solution is to use the built-in capabili- 


ty of SQL Trace along with the RML utilities from MS 
PSS to analyze the information you really need. 
This session will cover all of these aspects in detail 
along with sample code that you can use to get 
started immediately with your quest to seek out 
the worst offending statements in your system. 


SDB304: SQL SERVER CONFIGURATION 
BEST PRACTICES 
ANDREW KELLY 


There is simply no substitute for proper planning 
when it comes to deploying and configuring a SQL 
Server instance. Do you know what options you 
should change or set when installing or configur- 
ing a SQL Server instance? If not, you are certainly 
not alone. This session will cover the best practices 
for the key areas regarding the configuration of 
the SQL Server instance and the underlying server. 
Keeping these best practices in mind will give you 
a head start on ensuring your database will be 
scalable and perform at its best. 


SDB305: LEVERAGING CENTRALIZED 
MANAGEMENT SERVERS IN SQL SERVER 2008 
KIMBERLY L. TRIPP 


SQL Server 2008 has a variety of features that aid 
in supporting multiple servers-from Centralized 
Management Servers to Multi-server Script 
Execution to Policy-based Management and 
Performance Data Collection. Attend this session 
and see how you can easily execute scripts on mul- 
tiple servers, create policies that verify (and possi- 
bly set) your most critical database settings with 
only a few clicks. And, much of this can be done 
against your existing and earlier versions of SQL 
Server (limitations and restrictions will be cov- 
ered). Finally, collecting performance data from 
SQL Server 2008 servers and storing this data in a 
management data warehouse lets you better ana- 
lyze trends and tune the most expensive queries 
through interactive click-through reports (the 
reports are similar to Performance Dashboard). 
The combination of all of these options means that 
your SQL Server 2008 servers have the most capa- 
bilities, but even having a SQL Server 2008 man- 
agement server to help manage your existing 
(2000/2005) servers is a must. This session will be 
demo-packed and filled with practical solutions! 


SDB306: DBA MYTHBUSTERS 
PAUL S. RANDAL 


It's amazing how many myths and misconceptions 
have sprung up and persisted over the years about 
SQL Server-after 10 years helping people out on 
forums, newsgroups, and customer engagements, 
Paul has heard it all. Are there really non-logged 
operations? Can interrupting shrinks or rebuilds 
cause corruption? Can you override the server's 
MAXDOP setting? Will the server always do a table- 
scan to get a row count? These are just a few of 
many, many myths that Paul will debunk in this 
fast-paced session about how SQL Server operates 
and should be managed and maintained. 


SDB307: UNDERSTANDING LOGGING AND 
RECOVERY IN SQL SERVER 
PAUL S. RANDAL 


Some of the most misunderstood parts of SQL 
Server are its logging and recovery mechanisms. 
The fact that the transaction log exists and can 
cause problems if not managed correctly seems to 
confound many DBAs. Why is it possible for the 
transaction log to grow unbounded? Why does it 
sometimes take so long for the database to come 
online after a system crash? Why can't logging be 
turned off completely? Why can’t I recover my 
database properly? Just what is the transaction 
log and why is it there? In this in-depth session, 
Paul will unravel the mysteries of the transaction 
log-it's architecture and behavior under different 
recovery models-as well as how logging and recov- 
ery work in SQL Server. This is essential knowledge 
you need for understanding how backup, restore, 
log-shipping, database mirroring, and other tech- 
nologies work. 


SDB308: BUILDING THE RIGHT 
BACKUP STRATEGY 
PAUL S. RANDAL 


In many situations, database backups are critical 
for recovering from a disaster, but there are lots of 
misconceptions about how backups work and what 
a good backup strategy is. The purpose of taking 
backups is, of course, to be able to restore them at 
some point-but that can sometimes be easier said 
than done, depending on what you want to be able 
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to restore. In this in-depth session, Paul will explain 
how the three most common types of backups 
work and how they can be combined into an effec- 
tive backup strategy. Paul will also cover how 
restore works, the three recovery options for 
restoring a backup, and a variety of useful exam- 
ples. You don’t want to find out that your backups 
are unusable when disaster strikes-this session 
provides the knowledge you need to make sure you 
can recover. (It is recommended that you attend 
the Logging and Recovery session before this one.) 


SDB309: FOLLOW THE RABBIT: Q&A 
PAUL S. RANDAL & 
KIMBERLY L. TRIPP 


Now a conference staple, Kimberly and Paul come 
loaded with slides and highlights from all of their 
sessions of the conference. If you don’t ask ques- 
tions, they'll start adding to the content discussed 
previously by diving deeper and tying in discussions 
they've had in breaks, after their sessions and with 
your questions. This is really YOUR time to ask ques- 
tions! This session seems unfocused but is often not 
only informative but highly interactive and fun. 


SDB310: STANDARDIZE, CONSOLIDATE, AND 
VIRTUALIZE YOUR SQL SERVER 
INFRASTRUCTURE 

ROSS MISTRY 


As organizations use ever increasing numbers of 
applications to manage business processes, pro- 
vide new services, and gain an insight into busi- 
ness performance, the number of SQL Server sys- 
tems that are required to support those applica- 
tions has grown significantly. This typically leads 
to a proliferation of SQL Server systems, instances 
and databases within an organization's infrastruc- 
ture. However with the advances in hardware and 
SQL Server technologies, SQL Server systems can 
significantly handle greater workloads compared 
to the past. Therefore, it is now possible to consol- 
idate SQL Server databases onto a fewer physical 
servers, which results in better utilization, reduced 
hardware and support costs. This session will out- 
line strategies of how to consolidate SQL Server 
systems and databases on fewer servers. In addi- 
tion, it will also focus on how to plan for consoli- 
dation and outline challenges DBAs may face. 


SDB311: IMPLEMENTING A SQL SERVER 
2008 FAILOVER CLUSTER WITH WINDOWS 
SERVER 2008 

ROSS MISTRY 


So your boss has given you the marching orders to 
build a new failover cluster with SQL Server 2008 
on Windows Server 2008. The challenge-where do 
| start? What edition of SQL Server 2008 should | 
use? What edition of Windows Server 2008 should 
| use? Do | need shared storage? If so, how should | 
carve up the LUNs? Does SQL Server support 
active/active failover clustering? What is the differ- 


ence between single instance and multiple failover 
instance configurations? Does SQL Server support 
stretch clustering? As you can see, there are 
numerous items which need to be correctly 
addressed. This session will provide you with the 
knowledge to successfully plan and implement a 
SQL Server 2008 failover cluster on Windows Server 
2008. Tips, tricks and best practices will be covered. 


SDB312: ACHIEVING SQL SERVER HIGH 
AVAILABILITY WITH HYPER-V R2 AND LIVE 
MIGRATION 

ROSS MISTRY 


Virtualization is a major part of today’s data cen- 
ters. The operating efficiencies offered by virtual- 
ization allow organizations to dramatically reduce 
operational effort and power consumption. This 
session will cover best practices and strategies 
associated with running SQL Server 2008 on 
Hyper-V specifically with Windows Server 2008 R2. 
Moreover, you will understand how to leverage the 
new features and functionality associated with 
Windows Server 2008 R2 in order to virtualize SQL 
Server while also achieving high availability and 
disaster recovery from a single solution. 


SDV301: A DATABASE DEVELOPER AND DBA 
PERSPECTIVE-LINQ TO SQL AND ENTITY 
FRAMEWORK VS. STORED PROCEDURES 
BOB BEAUCHEMIN 


This session covers the performance implications of 
using two new Microsoft data access frameworks. l'Il 
look at the good, the bad, and the ugly aspects of 
code generation with the frameworks using SQL 
Profiler, plan cache monitoring, and query plans. l'Il 
cover what the frameworks bring to the table when 
compared to using T-SQL stored procedures or using 
dynamic SQL and the obvious benefits to the appli- 
cation programmer. T-SQL code generation 
enhancements in .NET 4.0 versions of Entity 
Framework and LINQ to SQL will also be explored. 


SDV302: VISUALIZING AND EXTENDING SQL 
SERVER SPATIAL DATA: MAPS, REPORTS, 
AND ANALYSIS 

BOB BEAUCHEMIN 


SQL Server 2008 R2 (Kilimanjaro release) will put 
spatial data support (including Bing Maps support) 
inside SQL Server Reporting Services, extending 
the data type's usefulness to include maps and 
direct integration. And the spatial data types are 
even supported in the MapPoint application 
through a custom add-in. I'll also show how to use 
SQL Server Spatial Data with Bing Maps directly, 
walking through a simple code example of how it's 
done. Finally, I'll show how you can write your own 
extensions to the spatial library with examples. 


SDV303: MODELING AND IMPLEMENTING 
HIERARCHIES WITH SQL SERVER 
BOB BEAUCHEMIN 


This session looks at support in SQL Server for 
hierarchical data, comparing and contrasting the 
methods of maintenance and query. I'll focus on 
SQL Server 2008's new hierarchylD data type, with 
a look at performance and ease-of-use compared 
with the adjacency model, nested set model, and 
XML storage and query. 


SDV304: COMPLEX EVENT PROCESSING 
WITH STREAMINSIGHT 
BOB BEAUCHEMIN 


While typical relational database applications are 
query-driven, event-driven applications have 
become increasingly important. Event-driven appli- 
cations are characterized by high event data rates, 
standing queries, and millisecond latency require- 
ments requiring the data to be queried (and possi- 
bly summarized) while it's in-flight. These require- 
ments are shared by various scenarios across ver- 
ticals such as manufacturing, oil and gas, power 
utilities, financial services as well as IT and data 
center monitoring. Microsoft's StreamInsight prod- 
uct (now in CTP) uses an event provider model to 
produce, process, and consume streams of data. A 
LINQ query provider gives you the ability to query 
and morph data streams in-flight. 


SDV305: EXPLORING SQL SERVER AZURE 
DATABASE AND DATA TIER APPLICATIONS 
BOB BEAUCHEMIN 


Although SQL Server Azure database applications 
(database in the cloud) and Data Tier Applications 
(an application management feature in SQL Server 
2008 R2) are totally different features, they are 
both implementations of non-traditional ways to 
manage applications. The set of SQL Server func- 
tionality that each one offers is amazingly similar. 
This session will show how to take a “traditional” 
application in a SQL Server database and either 
deploy it to the cloud or deploy it as a DAC appli- 
cation for local consumption and easier applica- 
tion deployment mobility. 


SDV306: DEBUGGING T-SQL: POWER TOOLS 
AND BEST PRACTICES 

DON KIELY 

Management Studio in SQL Server 2005 and 2008 
is built on Visual Studio, which means that there 
are a ton of debugging tools built into 
Management Studio. You've probably at least 
played with stepping through code, checking cur- 
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rent values of local variables, and other basic 
techniques. But there is Oh, so much more! This 
session will explore some of the more powerful 
debugging techniques available in Management 
Studio so that you can start on your way to being 
a debugging ninja. We'll also cover some best 
practices for eradicating the little pests from your 
T-SQL code, as well as some tips and tricks to 
make your debugging sessions more effective. 


SDV307: ENCRYPTION 2.0: SQL SERVER 
2008 TAKES IT FURTHER 
DON KIELY 


Data encryption was introduced in SQL Server 
2005 as a great feature for protecting your most 
sensitive data. Microsoft did a fine job with 
Encryption 1.0, and it only gets better in SQL 
Server 2008. Probably the best new feature for 
some scenarios is Transparent Data Encryption, 
which encrypts complete database and log files. 
But when that is overkill, you can encrypt only the 
specific data that needs protection. Another great 
new feature is external key management. During 
this session, we'll explore the encryption options 
presented in SQL Server 2008 and see how they 
can add a nearly impenetrable layer of protection 
to your data, as well as look at where there could 
be chinks in the armor. 


SDV308: MASTERING MANAGEMENT 
STUDIO FOR OPTIMAL PRODUCTIVITY 
DON KIELY 


There's a good chance that you use Management 
Studio most days, whether you are a DBA or a 
developer. It makes a lot of routine tasks easy, 
such as writing queries, setting up security, and 
doing quick or detailed checks on a server's 
health. But how well do you really know it? Have 
you customized it to better suit the way you work? 
Do you know how to incrementally search script 
files? Do you know how to fix corruptions in its 
settings files? Are you able to display cute cat pic- 
tures in it? In this session we'll explore many of 
Management Studio's hidden and lesser known 
features that can make you much more produc- 
tive when working with SQL Server, and make it a 
more fun environment to work in. 


SDV309: EXPLORING SQL SERVER 2005 
AND 2008 SECURITY 
DON KIELY 


There are few corporate assets as valuable in the 
information age as data. Enterprises spend bil- 
lions to collect and generate it, slice and dice it in 
every conceivable way to mine marketplace intel- 
ligence from it, and replicate and back it up using 
elaborate, redundant schemes. Yet it is all too 
common to slack on security. Sure, SQL Server 
2005 and 2008 are designed to be “secure by 
default,” but once you add databases and start 
letting users and their applications access the 


server you have already poked holes in the secu- 
rity. SQL Server comes with plenty of features that 
let you secure data, but it can be hard to get a 
handle on the right ones to use in your environ- 
ment. During this session, we'll explore myriad 
security features in SQL Server and how to put 
them to use in applications. 


SDV310: SQL SERVER COVERING: 
CONCEPTS, CONCERNS, AND COSTS 
KIMBERLY L. TRIPP 


Using indexes to “cover a query” is one of the 
more important tuning strategies possible in SQL 
Server. So much so that many of the best indexing 
performance features target specifically this- 
covering. We'll look at indexed views 
(added/improved in SQL Server 7.0 and 2000), 
INCLUDE (added in SQL Server 2005) and filtered 
indexes (added in SQL Server 2008). In this ses- 
sion, we'll discuss the pros and cons of covering, 
and the different strategies possible to achieve it- 
as well as when it's a good idea to consider cover- 
ing and when it's a must! 


SDV311: STATISTICS: ARE THEY REALLY 
IMPORTANT? 
KIMBERLY L. TRIPP 


SQL Server uses a cost-based optimizer which 
means that each query/batch submitted is evalu- 
ated in a variety of ways to determine the execu- 
tion plan. If a query needs to process 10 rows the 
plan might be quite different than a query that 
must process millions of rows... but how does SQL 
Server know how many rows to process if all it 
knows is your query? The answer is statistics. 
Statistics are the basis of estimation for selectiv- 
ity and join density-they are the most important 
piece of information that the optimizer has to 
help it do a better job. So, how do you make sure 
that your statistics are good, accurate, and up-to- 
date? Where are these stored? What do they look 
like? Are there cases where statistics just aren't 
good enough? How do you deal with these situa- 
tions? Come to this session and find out! 


SDV212: GUIDS: A GIFT OR A GREMLIN? 
KIMBERLY L. TRIPP 


Since the invention of the GUID (April 1, 1995) my 
life as a DBA and “tuner” has been busy. I've seen 
databases designed with GUID keys run fairly well 
with small workloads completely fall over and fail 
because they just cannot scale. And, | know why 
GUIDs are chosen-it simplifies the handling of 
parent/child rows in your batches so you can 
reduce round-trips or avoid dealing with identity 
values. And, yes, sometimes it's even for distrib- 
uted databases and/or security that GUIDs are 
chosen. I'm not entirely against ever using a GUID 
but overusing and abusing GUIDs just has to be 
stopped! Please, please, please-database devel- 
opers-come to this session so | can give you bet- 


ter solutions and explanations on how to deal with 
your parent/child rows, round-trips and clustering 
keys! 


SBI301: INTEGRATING REPORTING SERVICES 
WITH APPLICATION SECURITY 
BRIAN LARSON 


In many cases, we need the Reporting Services 
report server or a Reporting Services report to 
enforce some security restrictions. This requires 
the report server and the report to know the user's 
identity. This session will explore techniques for 
passing credentials from a custom application to a 
Reporting Services report server. Both the use of 
standard Windows Integrated security and a cus- 
tom security extension will be examined. 


SBI202: TUPLES, SETS AND MEMBERS: 
UNDERSTANDING THE BASICS OF MDX 
BRIAN LARSON 


You may be comfortable using the Reporting 
Services graphical MDX query designer, but to truly 
unlock the power of Analysis Services you need to 
be able to code your own MDX queries. The hardest 
part of this process can be understanding the 
basics. This session will provide a solid under- 
standing of what makes up MDX queries and will 
give you the tools and confidence you need to cre- 
ate your own custom queries. 


SBI303: THINKING OUTSIDE THE TABLIX: 
CREATIVE USES OF REPORTING SERVICES 
BRIAN LARSON 

Reporting Services is a powerful tool for creating 
busines charts and reports. That power can also be 


harnessed for a number of non-traditional uses as 


well. These include menuing, capturing user input, 
generating mail merge documents, and more. This 
session will expand your horizons; allowing you to 
use Reporting Services in new and creative ways. 


SBI304: COMBINING DISPARATE DATA IN AN 
SSRS REPORT 
BRIAN LARSON 


One of the limitations of Reporting Services is the 
inability to relate data from two disparate data 
sources within a report. This session explores var- 
ious techniques for overcoming this limitation. 
When security restrictions or other constraints 
make linked servers an impossibility, these 
approaches allow you to combine data from multi- 
ple sources and provide your users with the analy- 
sis they require. 
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SBI205: GEMINI: DELIVERING 
SELF-SERVE BI 
CRAIG UTLEY 


If you are always looking for better ways to deliv- 
er value to the business as part of a BI project, 
make sure you examine the capabilities of Gemini. 
Using existing data and tools, users now have the 
ability to analyze vast quantities of data without 
first designing dimensions and measure groups. 
Users can explore the data and optionally share 
their analysis with others. See how Gemini opens 
the power of Analysis Services to non-technical 
users while still allowing the IT organization to 
administer and secure the data. 


SBI206: ANALYSIS SERVICES 2008 
END-TO-END 
CRAIG UTLEY 


Are you interested in designing, building, and 
deploying an Analysis Services database that fol- 
lows best practices and best delivers value to your 
organization? This session goes through the 
process of optimizing cube creation through the 
proper design of dimensions, measure groups, 
aggregations, calculations, perspectives, security, 
and more. The areas of source code control, 
deployment, promotion from test to production, 
processing efficiency, and other areas will be dis- 
cussed. Craig Utley has experience designing, 
implementing, and troubleshooting Analysis 
Services databases at dozens of companies world- 
wide through his more than 11 years of experience 
with the Microsoft BI stack. Far from a theoretical 
discussion, this session will present real-world les- 
sons learned about what works in production 
environments. By attending this session, you will 
learn the proper design and implementation of 
your Analysis Services databases, allowing you to 
avoid common pitfalls while delivering the maxi- 
mum value to your clients. 


SBI407: ADD IT UP: ANALYSIS SERVICES 
AGGREGATIONS 

CRAIG UTLEY 

Are you looking to maximize the performance of 
your Analysis Services queries? This session 


hd 


explains what aggregations are and how they 
work. You'll learn how to create aggregations, 
tune the aggregations based on actual usage, and 
design custom aggregations when necessary. 
You'll discover the benefits and pitfalls of flexible 
aggregations, when to use rigid aggregations, and 
the meaning of lazy aggregation processing. You'll 
dive into queries to see if aggregations are being 
used and learn when aggregations aren't useful. If 
you thought aggregation design began and ended 
with the aggregation wizard, you owe it to your- 
self (and your cubes) to attend this session. 


SBI408: AVOID SLOW SSAS QUERIES: MDX 
QUERY TROUBLESHOOTING 
CRAIG UTLEY 


Do you have SSAS queries that you feel should be 
faster? Multidimensional Expressions, or MDX, is 
the language used to work with Analysis Services. 
Similar to SQL for the relational engine, MDX is a 
language for queries and DDL statements on mul- 
tidimensional cubes in Analysis Services. 
Troubleshooting slow MDX queries is often chal- 
lenging because the level of support provided by 
the tools and the Analysis Services engine is not 
as mature as that found in the relational engine. 
This session covers the methods for examining 
slow queries using the SQL Profiler and 
Performance Monitor to determine the need for 
aggregations, caching problems, memory con- 
straints, and so forth. Best practices for optimiz- 
ing MDX will be examined, and various server 
properties will be discussed as necessary to help 
correct query issues. Attendees will leave armed 
with a practical approach to locating bottlenecks 
and strategies for speeding up queries. 


SBI409: DEMYSTIFYING ANALYSIS 
SERVICES STORED PROCEDURES 
STACIA MISNER 


Analysis Services stored procedures are nothing 
like the stored procedures you create for your SQL 
Server databases. Not much is written about this 
feature, so you might wonder whether you need to 
bother with them at all. Put simply, you can sim- 
plify your MDX queries, combine cube data with 


relational data, or personalize calculations for 
specific users-just to name a few possibilities with 
a little C# (or VB) code and MDX. Come to this ses- 
sion to learn some practical ways you can take 
advantage of Analysis Services stored procedures. 


SBI210: EXPLORING THE NEW REPORTING 
SERVICES 
STACIA MISNER 


Reporting Services comes with lots of new features 
in Kilimanjaro, including the Shared Component 
Library, map controls, data feeds, lookup functions, 
and other enhancements. In this session, you'll 
learn the tips and tricks necessary to use these 
features to full advantage in your report develop- 
ment projects. 


SBI211: WHAT'S DAX? 
STACIA MISNER 


Sure, that Gemini application looks pretty in the 
demo, but its real beauty lies in the power of the 
calculations that give meaning to raw data. DAX is 
the new expression language that provides this 
power-taking familiar Excel functions to new lev- 
els, adding new functions to perform tasks never 
before possible in Excel, and allowing you to add a 
business logic without knowing a thing about 
dimensions and measures. In this session, you'll 
learn how best to get started with DAX so that you 
can take full advantage of Gemini’s power. 


SBI212: DATA, DATA, WHO OWNS THE DATA? 
STACIA MISNER 


The SQL Server code-name “Kilimanjaro” release 
includes a new feature, called Master Data 
Services, to support master data management 
(MDM). You might be wondering, “If I'm already 
cleansing and conforming heterogenous data in 
my centralized data warehouse, why do | need 
Master Data Services?" Or conversely, “If | imple- 
ment Master Data Services, do | really need a data 
warehouse?” Come to this session to learn the 
answers to these questions and how to use Master 
Data Services to integrate MDM into your data 
warehouse architecture. 
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PRE-CONFERENCE WORKSHOPS 


VISUAL STUDIO WORKSHOPS 


SUNDAY, APRIL 11, 2010 9AM - 4PM 
VPRO1: EVERY CLASS AS A SERVICE-WCF AS THE NEW .NET 
JUVAL LOWY 


Contrary to common wisdom, service-orientation is not just for high-end appli- 
cations. Every application should be service-oriented, and Windows 
Communication Framework (WCF) is the NET runtime for developing, deploying 
and consuming service-oriented applications. But what is service-orientation 
really about? What does it mean for mere developers? Is there substance 
behind the hype? In this comprehensive one-day workshop, Juval will first 
demystify service-orientation, and introduce the basic motivation for service- 
oriented applications and their operating principal and concepts. In that light, 
Juval will then describe what WCF is and how it is designed, and demonstrate 
its advantages over traditional NET programming. You will see that WCF is 
more than just the next generation platform for building connected systems. In 
many respects, WCF is the next development platform for Windows applica- 
tions, providing system features that are presently crafted by hand on top of 
.NET and Windows. With WCF, every class automatically benefits from these sys- 
tem features, from security to transactions to tracing and logging and much 
more. To maximize the use of these off-the-shelf plumbing aspects you should 
push the service boundary down into your system, but taken to its ultimate 
conclusion-should every class be a WCF service? And what about perform- 
ance? This workshop will next demonstrate the power and productivity of WCF, 
contrasting WCF used granularly on every class with classic .NET in terms of 
performance, throughput and scalability, and will substantiate the provocative 
claim that every class can and should be a service. Don't miss on this unique 
opportunity to understand SOA and WCF from Juval Lowy who has been part of 
the strategic design effort for WCF from the beginning, and who offers a pro- 
found insight on the methodology, the technology and its application. 


SUNDAY, APRIL 11, 2010 9AM - 4PM 
VPRO2: ESSENTIAL BUSINESS DESKTOP PROGRAMMING WITH .NET 
PAUL D. SHERIFF 
Are you constantly struggling to keep up with all the new technologies coming 
out from Microsoft? Are you finding that you are avoiding conferences because 
you do not understand the sessions being presented? If you wish to learn the 
basics of some the new desktop technologies then this workshop is for you. 
The intent of this workshop is to prepare you for the sessions at the Visual 
Studio Launch conference. If you are fairly new to .NET, or have been doing 
desktop or Web development with .NET for awhile and you wish to learn the 
essential elements behind the new technologies like WPF, WCF and Unit Testing, 
you will find them here. In this one day, you will be exposed step-by-step to 
each of these technologies so you will feel comfortable moving on with more 
advanced topics. The following topics will be covered in this workshop: 

= The essential OOP concepts you must know to be productive with NET 

= How, When and Why to use WCF 
Learn WPF from the ground up 
Data access methods for WPF 

= Architecting for Unit Testing 
Prerequisites: You have some basic knowledge of .NET. 


ASP.NET WORKSHOP 


SUNDAY, APRIL 11, 2010 9AM - 4PM 
APRO1: SILVERLIGHT 4 DEVELOPMENT WORKSHOP 
DAN WAHLIN 


Silverlight 4 provides a powerful framework that can be used to build Rich 
Internet Applications (RIAs) that look and feel much like a desktop application 
yet are deployed like traditional web applications. In this full-day workshop, 
Silverlight MVP Dan Wahlin will walk you through different features and tools 
that can be used to build Silverlight applications. Topics covered include XAML 
fundamentals, using layout and data entry controls, data binding, retrieving 
data from remote services, animations, out-of-browser options, printing, MVVM 
architecture concepts and more. If you're looking to jump-start your Silverlight 
development projects, this is the workshop for you! 


SQL SERVER WORKSHOPS 


SUNDAY, APRIL 11, 2010 9AM - 4PM 

SPR301: DO YOU FEEL THE NEED FOR SPEED? TUNING FOR 
HIGH PERFORMANCE 

KIMBERLY L. TRIPP AND PAUL S. RANDAL 


Whether you're designing from the ground up or tuning a third-party applica- 
tion, this workshop will show you ways to tune even if you can't change the 
code or schema. We'll cover designing for performance, indexing for perform- 
ance, and maintaining performance. These areas sound very generic but we'll 
show you the top things you can put into production straight away to give you 
the biggest bang for your buck. Topics will include effective table design, ver- 
tical and horizontal partitioning, data type best practices, clustering key 
choice, nonclustered index strategies, fragmentation analysis, index and sta- 
tistics maintenance, and more! 


SUNDAY, APRIL 11, 2010 9AM - 4PM 


SPR302: A 360-DEGREE VIEW OF SQL SERVER 2008 R2 
BUSINESS INTELLIGENCE 


STACIA MISNER 


In this session, we'll take a holistic look at the BI features in the latest version 
of SQL Server by reviewing the architecture requirements, exploring the impli- 
cations for existing BI applications, and introducing new capabilities that sup- 
port the transformation of data into business insight. We'll discuss the scala- 
ble data warehousing capabilities supported by “Madison”, master data man- 
agement with Master Data Services, and complex event processing with 
Streaminsight. We'll also explore the new self-service reporting and analysis 
features in Reporting Services and Gemini. Of course, you'll see demonstra- 
tions of the new features in this session, but you'll also have a chance to ask 
lots of questions and to get a look “under the hood” to better understand what 
you'll need to do to get the R2 BI features up and running properly. You'll also 
learn how to prepare your data environment to leverage these features and 
how best to manage the user experience. 


NOTE: LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS - THE COST OF A WORKSHOP IS IN ADDITION TO THE REGULAR CONFERENCE FEE 


April 12-14 2010 | Las Vegas, NV | 19 


POST-CONFERENCE WORKSHOPS 


VISUAL STUDIO WORKSHOPS 


THURSDAY, APRIL 15, 2010 9AM - 4PM 
VPSO1: AZURE TOP TO BOTTOM 
MICHELE LEROUX BUSTAMANTE 


The Windows Azure platform is Microsoft's cloud computing initiative supplying 
an operating system in the cloud-hosted in Microsoft data centers-in addition 
to data storage and other infrastructure and application services. It provides 
businesses with on-demand hosting, storage and management features in 
fashion with utility computing. This workshop will explore the cloud computing 
offerings from Microsoft including Windows Azure, SQL Azure, and the Windows 
Azure platform AppFabric. You'll learn how Windows Azure can help businesses 
scale operations in the cloud, and how developers can build and deploy appli- 
cations and services to the cloud with familiar development tools. You'll learn 
about storage options offered by Windows Azure and how that compares to SQL 
Azure; and how to employ the Service Bus and Access Control Service (part of 
AppFabric). This workshop will focus on practical reasons for applications to 
leverage each of these cloud offerings and dive deeper into many of the core 
services with demonstrations. At the end of this workshop, you will understand 
the lifecycle for building, deploying and securing applications in the cloud. 


THURSDAY, APRIL 15, 2010 9AM - 4PM 
VPSO2: REAL-WORLD DEVELOPMENT IN SILVERLIGHT AND WPF 
-BEYOND THE BASICS 


BILLY HOLLIS 


Do your Silverlight and WPF interfaces look like decorated versions of older 
technologies? Are you ready to really start taking advantage of advanced user 
interface technologies for greater productivity, lower training costs, and more 
satisfied users? Then come learn how to effectively use animation, transforms, 
styles, control templates, color, advanced layout options, and other capabilities 
to design and build impressive user interfaces in Silverlight and WPF. In the sec- 
ond half of the workshop, you'll see demonstration and analysis of a complete 
Silverlight Web site like the one at www.simasters.net that performs page nav- 
igation, animation of new pages, and contains other advanced features. Plus, 
you'll walk away with that code as a starting point for your own efforts. If 
you're ready to learn and apply real-world lessons for advanced user interface 
development, this is the workshop for you. 


SQL SERVER WORKSHOP 


THURSDAY, APRIL 15, 2010 9AM - 4PM 
SPS301: WRITING SQL SERVER DATABASE APPLICATIONS AND 
STORED PROCEDURES FOR BEST PERFORMANCE 


BOB BEAUCHEMIN 


In a database-centric application, whether the application performs well is usu- 
ally highly dependent on whether the database code performs well. At the 
same time, we're moving from traditional data access techniques like ODBC and 
ADO.NET to database code generation and object-relational mapping layers 
such as the ADO.NET Entity Framework. This gives application developers a 
choice of putting database code in stored procedures, using SQL code in appli- 
cations, or using LINQ and having your SQL generated for you. 
In this one-day workshop, we'll cover how knowing how the SQL query proces- 
sor, plan caching, and parameter processing works can vastly change your 
application's database performance. You have control of this performance no 
matter how you choose to access SQL Server and we'll cover performance 
issues both inside and outside the server. Some of the topics we'll cover 
include: 
= Does using LINQ relieve the developer of database performance 
responsibility? 
= Does writing stored procedures guarantee good performance? 
And are all stored procedures equally good performance-wise? 


= Are stored procedures always faster than dynamic SQL? 
= |s SQLCLR a good way to write stored procedures? 


We'll cover this with real-world examples illustrating methods to improve data- 
base code performance regardless of how the data access layer is structured. 
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HOTEL INFORMATION 


Join us! 
Bellagio Resort & Casino, Las Vegas, NV 


Grant yourself the luxury of discovery time as you explore the dramatic 
features which distinguish this exquisite Las Vegas resort from every 
other destination in the world. From dancing fountains to a breathtaking 
Conservatory & Botanical Gardens to serenity-splashed Pools & 
Courtyards, plus a refreshing addition to your entertainment options, 
the world famous Fountains of Bellagio were destined to romance your 
senses. Take in a complimentary Las Vegas show of water, music and 
light thoughtfully interwoven to mesmerize its admirers. 


HOTEL ACCOMMODATIONS BELLAGIO RESORT & CASINO 
3600 Las Vegas Boulevard South, Las Vegas, NV 89119 

Bellagio Resort & Casino is the conference site and host hotel. 

This is where all sessions and activities are held. 


We have secured a discounted conference rate of $149 per night plus tax (12%). 
Rate is based on single or double occupancy and based on availability. Hotel 
requires a one night room and tax deposit at time of reservation. (Credit card 
will be charged by the hotel). Hotel cancellation policy: Must cancel at least 72 
hours prior to arrival date. 


TAX DEDUCTION 
Your attendance to the conference 
may be tax deductible. 
Visit www.irs.ustreas.gov. Look for 


topic 513 - Educational Expenses. You Space is limited so reserve your room early by registering online or by calling 
may be able to deduct the conference the conference hotline at 800-438-6720 or 203-400-6121. All reservations 

fee if you undertake to (1) maintain or must be guaranteed with a major credit card to confirm room. A deposit of the 
improve skills required in your present first night room and tax will be charged. Cancellations must be received by the 
job; (2) fulfill an employment condition hotel 72 hours prior to the confirmed arrival date to receive refund of deposit 


mandated by your employer to keep 


your salary, status, or job. AIRLINE 


Please call Pericas Travel at 203-562-6668 for airline reservations. 

GROUP DISCOUNT 
Register individuals from one 
company at the same time and 


CAR RENTAL 
Hertz is offering auto rental discounts to attendees. See Web site for details. 


receive a group discount. ATTIRE 

The recommended dress for the conference is casual and comfortable. 
1-3 registrants $1,595 per person Please bring along a sweater or jacket, as the ballrooms can get cool with 
Additional registrants | $1,395 per person the hotel's air conditioning. 
after the 3rd ($200 off each) 
(4th, Sth, 6th...) SPONSORSHIP/EXHIBIT INFORMATION 


For sponsorship information, contact Rod Dunlap 
Call 800-438-6720 to take advantage 480-917-3527 phone + E-mail rod@devconnections.com 
of group discount pricing. See Web site for more details. www.DevConnections.com 


Notes & Policies: The Conference Producers reserve the right to cancel the conference by refunding the registration fee. Producers can substitute speakers and topics and cancel sessions without notice or 
obligation. Updates will be posted on our Web site at www.DevConnections.com. Tape recording, photography is not allowed at any session. Conference producers will be taking candid pictures of events and 
reserve the right to reproduce. By attending this conference you agree to this policy. You may transfer this registration to a colleague by notifying us before the start of the event. Please inform us if you 
have any special needs or dietary restrictions when you register. The conference registration includes the following subscriptions. This is not an additional expense and subtraction from prices listed is not 
permissible. SQL Server Conference registration includes a one-year (12 issues) print subscription to SQL Server Magazine for SQL Server Conference attendees only. Current subscribers will have an additional 
12-months added to their subscription. Subscriptions outside of the United States will be served in digital; $12.50 of the funds will be allocated toward a subscription to SQL Server Magazine ($49.95 value). 
Visual Studio Launch Conference and Expo & ASP.NET Conference registration includes a one-year (12 issues) print subscription to DevConnections Magazine for Visual Studio Launch Conference and Expo & 
ASP.NET conference attendees only. Current subscribers will have an additional 12-months added to their subscription. Subscriptions outside of the United States will be served in digital; $12.50 of the funds 
will be allocated toward a subscription to DevConnections Magazine ($34.99 value). 


Registration & Cancellation Policy: Registrations are not confirmed until payment is received. Cancellations before February 22, 2010 must be received in writing and will be refunded minus a $100 pro- 
cessing fee. After February 22, 2010 cancellations and no shows are liable for full registration; it can be transferred to the next Conference within 12 months or to another person. Microsoft, Microsoft .NET, 
ASP.NET, Visual Studio.NET, Microsoft SQL Server, Exchange and Windows are either trademarks or registered trademarks of Microsoft Corporation. All other trademarks are property of their owners. 


22 | Register Today! Call 800-438-6720 |] www.DevConnections.com | 


CONFERENCE REGISTRATION © APRIL 12-14, 2010 ONLINE www. DevConnections.com| 


FULL CONFERENCE REGISTRATION INCLUDES KEYNOTE ON APRIL 12TH 8:00AM, E-MAIL: | info@DevConnections.com 
THROUGH CLOSING SESSION APRIL 14TH, 4:30PM PHONE: (800) 438-6720 


(203) 400-6121 
FAX: (913) 514-9362 


NAME PRIORITY CODE MAIL: 
COMPANY TITLE Penton Media 
c/o Tech Conferences, Inc. 
STREET ADDRESS (REQUIRED TO SHIP MATERIALS) 731 Main Street Ste C3 
Monroe CT 06468 
CITY, STATE, POSTAL CODE COUNTRY 
TELEPHONE FAX E-MAIL ADDRESS (IMPORTANT) 
© Microsoft Visual Studio Launch Conference and Expo 
[|] Microsoft ASP.NET & Silverlight Conference and Expo 
[| Microsoft SQL Server Conference and Expo 
On or Before February 12th, 2010 „n $1495 
After February 12th, 2010.ean $1595 


FOR WHICH CONFERENCE ARE YOU REGISTERING? 


PRE-CONFERENCE WORKSHOPS SUNDAY, APRIL 11, 2010 LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS, 
VPROI: Every Class as a Service-WCF as the New .NET LOWY....mmnnnnnnnuninunnnnnunssnennenes 


VPRO2: Essential Business Desktop Programming with .NET SHERIFF. 
APRO1: Silverlight 4 Development Workshop — WAHLIN.. 
SPR301: Do You Feel the Need for Speed? Tuning for High Performance TRIPP & RANDAL „s.s... 


SPR302: A 360-Degree View of SQL Server 2008 R2 Business Intelligence —MISNER 2... 9AM = 4PM srusen 9399 


POST-CONFERENCE WORKSHOPS THURSDAY, APRIL 15, 2010 LUNCH IS INCLUDED WITH FULL DAY WORKSHOPS. 


[C] — VPSO1: Azure Top to Bottom BUSTAMANTE...uusnsnnssssniiinuniniiiinnnniiinnnnninnnmnnnGAM® AH ssn S399 
[C]  VPS02: Real-World Development in Silverlight and WPF—Beyond the Basics BILLY HOLLIS... 9AM- APM. sasssssstnssesnene $399 
[C]  SPS301: Writing SOL Server Database Applications and 
Stored Procedures for Best Performance BEAUCHEMIN .....ssssttmemneneenteeemuatanenaennene QAM > APM ssssseststsesen $399 
CONFERENCE MATERIALS 


FULL CONFERENCE REGISTRATION INCLUDES MATERIALS FOR THE CONFERENCE FOR WHICH YOU REGISTER; 
YOU MAY PURCHASE MATERIALS FOR THE OTHER CONCURRENTLY RUN EVENTS. 


(_] Microsoft Visual Studio Launch Conference and Expo CD caecsssssssssesssssessssesssssessssesssssessssessssseesaseesasseesnsnsessssessssessasescsnsee $75 
[C] Microsoft ASP.NET & Silverlight Conference and Expo CD .... 
[C] Microsoft SOL Server Conference and Expo CD .......... 


|_| CHECK (payable to Tech Conferences) All payments must be in US Currency. Checks must be drawn on a US bank. 


L_] CREDIT CARD CJ visa  [] MASTERCARD [] AMEX 
CREDIT CARD NO. EXPIRATION DATE 


Cardholder's Signature Cardholder's Name (print) 


Penton Media 


PRST STD 
c/o Tech Conferences, Inc. US POSTAGE 
731 Main Street, Suite C-3 PAID 
Monroe, CT 06468 PERMIT 21 


CCP&DF 


Mailroom: If addressee is no longer here, 
please route to MIS Manager or Training Director 


POWERED BY MICROSOFT AND DEVCONNECTIONS MAGAZINE 


MICROSOFT MICROSOFT MICROSOFT 


VISUAL STUDIO ASP.NEIG 
LACH SILVERLIGHT SERVER 


APRIL 12-14, 2010 LAS VEGAS, NV 


Bellagio Hotel and Casino 


Book 3 nights by February 12, 2010 at the Bellagio Hotel and receive $100 Bellagio certificate. 
Book NOW to get a special rate of $149 (a limited number of rooms at this rate, so reserve today). 


Celebrate the launch of Visual Studio 2010 


with Microsoft execs and Microsoft: Cin 
colleagues around the world! Visual Studio 


REGISTER EARLY—Take advantage of our Early Bird Special room rate of $149! 


CHECK WEB SITE FOR DESCRIPTIONS OF SESSIONS AND WORKSHOPS 


w.DevConnections.com| 800.438.6720 • 203.400.6121 e Register Early! 


